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1. Introduction 

The famous Borel-Weil-Bott theorem states that, for a reductive complex algebraic 
group G, the cohomology groups of any invertible sheaf on the flag variety G/ B are non 
zero in at most one degree, and in this degree the cohomology group is a simple G-module. 
This statement is no longer true for Chevalley groups in characteristic p, the cohomology 
group is non-zero only in one degree (for a dominant weight) but it is not a simple G- 
module anymore. Its structure is rather complicated and interesting, and studying it leads 
to Kazhdan-Lusztig theory. 

Let now G be a complex basic classical supergroup. Studying the cohomology groups on 
the flag supervariety G/B was initiated by Penkov and others ([20], [23]). They discovered 
that the Borel-Weil-Bott theorem is not always true in this case and proved that it is true 
for so called typical invertible sheaves. 

This question is closely related to the representation theory of the corresponding basic 
classical Lie superalgebra g. The category of finite-dimensional g-modules is not semi- 
simple, only typical simple modules do not have extensions with other simple modules. 
The problem of computing characters of atypical simple finite dimensional g-modules is a 
full-time occupation for several persons since 1977. The formula for typical highest weight 
modules was found in pJTj. In 1980 Bernstein and Leites found the character formula 
in case g = sl(l,n) ([2]), later this formula was generalised for osp(2,2n) and for the so 
called singly atypical modules and generic atypical modules (see [29] and [30J). Similar type 
formulae were conjectured in |18j for affine superalgebras. In 1996, the second author [23] 
solved the problem completely for gl(m, n) using the geometry of flag supervarieties. Later 
Brundan [3] solved this problem by a different, purely algebraic, method and discovered 
a remarkable connection with the representation theory of gl(oo). Brundan's method was 
developed further in [8], [4], [5], [6], [7]. 

In this paper we generalise the method of [24] to the orthosymplectic groups OSP{m, 2n). 
The results were announced in [25] without proof and one statement (typical lemma) was 
formulated with a mistake there. We take a different Borel subgroup in this paper and use 
the language of weight diagrams (invented by Brundan and Stroppel for GL{m,n)). This 
makes the combinatorics much easier and allows one to formulate a precise algorithm for 
the computation of the characters of all simple modules. In the gl case, there exist finite 
dimensional analogues of Verma modules, called Kac modules, which can be interpreted 
as cohomology groups of bundles over the flag super manifold, and which also have a nice 
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algebraic behavior. Unfortunately (?), there is no such analogue in the orthosymplectic 
case, so we use the geometrical method. 

Let us explain the main idea of the method. As was pointed out by Penkov, one can 
easily write down the character of the Euler characteristic for any invertible sheaf on a flag 
supervariety using classical Borel-Weil-Bott theory. Thus, if one knows the multiplicities 
of simple modules in cohomology groups, one hopes to express the characters of simple 
modules as linear combinations of characters of Euler characteristic of some invertible 
sheaves. We manage to find these multiplicities for some generalized super grassmannians 
G/P for certain parabolic subgroups P, and use this information to compute characters. 

There are several complications in the case of 0SP{m,2n) compared with GL{m,n). 
First, in many cases the Euler characteristic is zero on G/B^ and one should consider 
instead G/Q for a suitable choice of a parabolic subgroup Q which depends on the module 
whose character we want to calculate. Next, there is no distinguished Borel subgroup in 
OSP{m, 2n), hence there are non- vanishing cohomology groups in many degrees. Finally, 
the recursion process involving the computation of the cohomology is more complicated 
due to the existence of the so-called exceptional pairs (see Section 10 in the paper for 
details). On the other hand, there is one advantage: the character of a simple OSP{m, 2n) 
-module is always a finite linear combination of Euler characteristics, in contrast with the 
GL{m,n) case where the combination is always infinite. 

The organisation of the paper is as follows. In Section 2 we fix the notations. Section 3 
contains general statements about cohomology groups of vector bundles on a supergrass- 
mannian G/P. In Section 4 we compute the character of the Euler characteristic, and, for 
parabolic subgroups P C Q C G, relate the cohomology on G/P with those on G/Q and 
Q/P, using Leray spectral sequence. Section 5 contains a complete classification of the 
blocks in the category of finite-dimensional g-modules (Theorem [2]) and introduces trans- 
lation functors. In Section 6, we introduce weight diagrams and translate the results of 
Section 5 into this language. In Section 7 we explain how to reduce the computation of the 
cohomology to the case of the most atypical blocks of Ql{k, k), 05p(2A; + 1, 2k), osp(2/c, 2k) 
and 05p(2A; + 2,2k). (Afterwards we concentrate on the orthosymplectic case, since the 
general linear case is done in [24J). This last computation is done recursively in Sections 
8,9 and 10 starting with osp(2fc + 1,2A;) (resp. 05p{2k,2k), osp(2A; + 2,2k)) and getting 
down to 05p(2A; - 1,2A; - 2) (resp. 05p(2A; - 2,2A; - 2), osp{2k,2k - 2)). In Section 11, 
the recursion is solved. We construct a graph whose vertices are weight diagrams and 
describe a combinatorial algorithm for the computation of cohomology groups, in terms of 
paths in this graph (Proposition [7] and Theorem [S]). Section 12 presents an algorithm for 
calculating characters (Theorem H} and contains some examples. In Section 13, we present 
a simplfication of the Section ll's algorithm. In the general linear case, this simplification 
leads to the equivalence (proven in [22]) of algorithms appearing in [23] and [3j. 

Both authors thank Laurent Gruson for hospitality and stimulating discussions. The 
second author would like to thank Ian Musson for explaining the method of weight dia- 
grams and fruitful discussions on supergeometry. 



2. Notations 

Let = 00 ffi 01 be a basic classical complex Lie superalgebra, i.e. = 0[(m,n) or 
osp(m, n). By G we denote the linear algebraic groups GL{m,n) and OSP{m,n) respec- 
tively [19]. For a Lie subalgebra (e.g. a C 0), we denote with the capital Latin letter 
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(in this case A C G) the connected complex algebraic supergroup with the given Lie su- 
peralgebra. For all the superalgebras considered in this paper such supergroups are well 
defined. 

We fix a Cartan subalgebra I) oi g. Denote by A the set of roots of g with respect to f). 
Let b be a Borel subalgebra of g containing [), it defines a set of positive roots A"^, and 
we define p = po — pi, where po is the half sum of the positive even roots and pi is the 
half sum of positive odd roots. Recall that since g is basic classical, it is equipped with 
a non degenerate invariant bilinear form and the restriction of this bilinear form to f) is 
also non degenerate. We will denote this form by ( , ). We denote by W the Weyl group 
of the even part go- Recall that in our case the Cartan subalgebra f) of g is also a Cartan 
subalgebra of go- For a Lie subalgebra o C g such that f) C a we denote by A (a) C A the 
set of roots of a. 

A weight A G f)* is integral if it induces a one-dimensional representation of the Cartan 
subgroup H. In the paper we consider only integral weights. Thus, by a weight we always 
mean an integral weight. Moreover, we only consider modules which are integrable with 
respect to the group G: all those have integral weights. Define the standard order on 
the set of integral weights: A<^iff;U — A = Y2aeA+ "-""^ where all are non-negative 
integers. 

For any integral weight A, we will denote by Lx the simple g-module with highest weight 
A, and if a is a Lie subalgebra of g for which it makes sense, we will denote by Lx{a) the 
irreducible a- module with highest weight A. Recall that A is called dominant (resp. a- 
dominant) if Lx (resp. Lx{a)) is finite-dimensional (in this case Lx (resp. Lx{a)) has a 
natural structure of G-module (resp. ^-module)). 

Let h({g) be the universal enveloping algebra of g and Z{q) be its center. For every 
weight A, we write x\ for the corresponding central character. A central character x is 
dominant if there exists a dominant A such that X = XA • 

Finally, let us recall the description of A (see [16]). Let g = gl(m, n), osp(2m, 2n) or 
osp(2m + 1, 2n). Then dim i) = m + n and one can choose a basis ei, Em, Si, 6n of [)* 
such that 

{ei,ej) = 6ij, {ei,6j) = 0, {6i,6j) = -5ij. 

The even roots Aq of g[(m., n) are all vectors of the form Si — ej and 6i — 6j with i ^ j- 
The odd roots Ai of Ql{m, n) are all vectors of the form Si — Sj and 5i — ej. 

The even roots Aq of osp(2m, 2n) are all vectors of the form itej ± ej, ±5j it 6j (the 
signs can be chosen independently) with i ^ j and 25j. The odd roots Ai of osp(2m, 2n) 
are all vectors of the form zbej it 6j . 

The even roots Aq of 05p(2m + 1, 2n) are all vectors of the form itej it ej, ±5i =b 6j with 
i 7^ j, ibej and zb2(5j. The odd roots Ai of 05p(2m + l,2n) are all vectors of the form 
±ei ± 5j and ±5j. 

We define a parity on the weight lattice by saying that Ei (resp. 6j) is even (resp. odd). 
Then the category of finite dimensional G-modules splits in a direct summand of two 
parts, one in which the weight spaces have the same parity as the corresponding weight, 
and one in which the parities differ. In this paper, we will only consider the first part. 

3. Geometric induction 
Let p be any parabolic subalgebra of g containing b and [ denote the reductive part of 

P- 

For a P-module e.g. V, we denote by the calligraphic letter V the vector bundle G XpV 
over the generalized grassmannian G/P. Note that the space of sections of V on any open 
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set has a natural structure of g-module, in other words the sheaf of sections of V is a 
g-sheaf. Therefore the cohomology groups {H^{G/ P,V)) are g-modules. For details see 

[23], m- 

Define the functor Fj from the category of p-modules to the category of g-modules by 

ri{G/P,V) := {H\G/P,V*)r- 

Lemma 1. - The functors Fj have the following properties: 

1) tf 

is a short exact sequence of P -modules, then one has 

. . . ^ Fi(G/P, W) ^ Fo(G/P, U) ^ Fo(G/P, V) ^ Fo(G/P, W) ^ 

(long exact sequence). 

2) if M is a Q-module and V is a P-module, the following holds : 

Ti{G/P, V®M)= Ti{G/P, V) (g> M. 

The proof is an adaptation of standard arguments (see [15] ) . 

Lemma 2. - The module Tq{G/P, V) is the maximal finite- dimensional quotient o/W(0)<8)^/(p) 
V. 

Proof. - Let V be the maximal finite-dimensional quotient of ^(5) ®u(p) ^ ■ By duality V* 
is the maximal finite-dimensional submodule in the coinduced module Hom^(p)(Z//(g), V*\ 
Let F(y*) := /?°(G/P, V*). By definition 

F(y*) = {7 G C[G] V*\i{gp) = p-h{9),9 e G,p G P} . 

Let vr denote the composition of the standard maps V — > U{g) ®u{p) V ^ V and 
TT* : y* — > V* be the dual map. Then 7^(5) = -K*(g~^v) is a vector in T{V*). Hence we 
can define a G-module homomorphism : V* ^ T{V*) by putting ip{v) := 7^,. We claim 
that if is injective. Indeed, assume X = Kevip ^ 0. But tt*{X) 7^ for every non-trivial 
G-submodule X C V*. Therefore X contains v such that 7i>(e) 7^ 0, hence ^p{X) ^ 0. 
Contradiction. 

On the other hand, the map ev : T{V*) — > V* defined by ev{'~f) := 7(e) induces a 
homomorphism of g-modules j : T{V*) Hom^(p)(Z//(g), T/*). Since T{V*) is finite- 
dimensional j{T(V*)) C V* . Again we claim that j is injective. Indeed, choose a nilpotent 
superalgebra m~ such that g = p ® m~, and let M~ be the corresponding supergroup. 
It is known that (exactly as in classical case) M~P is dense in G (see [21)). Hence ev is 
injective on the subspace of invariants F(y*)'" . Let Y = Ker j. Then Y"^ = 0. That 
implies Y = 0. 

Thus, we have two injective morphisms if : V* ^ T{V*) and j : T{V*) — > V* . Since 
the spaces are finite-dimensional, both ip and j are isomorphisms. Therefore, the dual 
modules V and Tq{G/ P,V) are also isomorphic. 

□ 

Definition 1. (Penkov's remark [23]) - Let {X,Ox) be a generalized grassmannian, and 
{Xq,Oxo) be the underlying algebraic variety, V be a G -vector bundle on X. Then the 
corresponding sheaf V on Xq has a filtration by OxQ-modules such that the associated 
graded module (in degree i) is isomorphic to the Go-bundle Vxo ® S^i-^Xo-^) ~' ' 
whole module will be denoted by IxqO^ ^ S'{N'x X)). 



By definition H^{X,V) = H^{Xq,V). We have, if we denote by Ch{V) the character 
of a Q module V, 

Ch{H^{XQ,Gr{V))) > Ch{H^{X,V)) 

as can be seen with the long exact sequence coming with the filtration ofV. The > means 
that each Qo-module occurring in H^{X,V) appears in H^{XQ,Gr{V)) with at least the 
same multiplicity. Note that the inequality becomes an equality when computing the Euler 
characteristic. 

Lemma 3. - If occurs in Vi(G/P,L\(p)) with non-zero multiplicity, then fj, + p = 
w{X + p) — Ylaei ^ f^''" ^ome w eW of length i and I C A^. 

Proof. - We make use of Penkov's remark. First, note that 

GriS\Afx,X)) = Go Xp, S^qUqo Pi)) 

which is a Go-bundle on Gq/Pq, so: 

Ch{H''{G/P,ji:^{pr))<Ch{H''{Go/Po,lGo/Po^UP)®S'{g/{go®Pi)r)). 

Assume occurs in Ti{G/P,L*^{p)). It means that L* occurs in ^{G / P,'Iq^/p^C\{p)). 
Therefore L^{qo)* occurs in H\Go/Po,C\{p) ® S*{q/{qo pi))*). The latter sheaf has a 
filtration by Go-bundles whose simple quotients are of the form ^Ct -v(po)- By the 

usual (non-graded) Borel-Weil-Bott theorem, if w{i'-\- p^) — pQ is regular and flo-dominant, 
then 

ti ^t.o/^o,>'^4Poj j - I Q otherwise 

Therefore 

H = w{X- 7 + Po)-po- 

7eJcA+ 

Using pQ = p + pi, we obtain 

p = w{X + p)-p- a, 

ae7cA+ 

where / = (w{J) n A+) U -(i«(A+ - J) n Aj"). □ 

Write p = [ © m, g = m~ © I © m, where m is the nilpotent part of p. Consider the 
projection 

4> : U{q) = U{m-)U{[)U{m) U{m-)U{\) 

with the kernel lA{Q)m. The restriction of (j) to Z{q) induces the injective homomorphism 
of centers — > Z{i). We denote by $ the dual map 

Hom{Z{[),C) Hom{Z{Q),C). 

Lemma 4. - If V is an irreducible p-module admitting a central character then the 
Q-module Ti{G/P,V) admits the central character $(x)- 

Proof. - Consider another projection 

V' : U{q) = U{m) «) U{1) U{m-) U{{)U{m-) 

with the kernel mW(g), and the corresponding dual map 

^ : Hom{Z{{),C) Hom{Z{Q),C). 
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Note that any element x G 1^{q) acts on the set of sections of the vector bundle V* over 
any open subset U C G/P. We denote this action by Lx- 

We claim that if 7 is a section of V* over any open subset U C G/P and z G -2(g) 
belongs to the kernel of ip, then ^2(7) = 0. Since z commutes with the group action, 
it suffices to prove that L^i^-f) G Ip, where Ip stands for the subspace of sections which 
are zero at P. Our claim now follows immediately from the facts that, if x G m, then 
Lxi'j) G Ip, and if x G I, then the value of Lx{'y) at p £ P equals x{'~f{p)). Thus, if C is 
the central character of [-module V* , then the space of sections T{U,V*) (as a g-module) 
admits central character ^'(C)- 

Using the Chech complex for the computation of the cohomology groups of V* , one can 
show easily that the cohomology groups H^{G/P,V*) also admit central character ^'(C)- 
Going to the dual modules provides the statement. □ 

The following corollary of Lemma [H2) and Lemma U] will be used a lot in this paper. 

Corollary 1. - For any finite- dimensional g-module M (resp. finite- dimensional p -module 
V) let (resp. ) denote the component with generalized central character x (resp. 

with generalized central character lying in <I>^^(x)j. Then 

r,(G/P, {V ® Mf'^^y) = {Ti{G/P, V) ® MY. 

Let J-" be the category of finite dimensional g-modules semisimple over i); this category 
decomposes into blocks J-^, where J^^ consists of all finite dimensional modules with 
(generalized) central character x- 

Remark - Let I be the Levi subalgebra of p. If y is a module belonging to the block 
J~'^{i) consisting all finite dimensional modules with (generalized) central character r, then 
Ti{G/ P,V) belongs to the block That provides a correspondence between blocks 

of [ and blocks of q. 

Definition 2. - Let X be a Q-dominant weight. Define A{X) to be a maximal possible set 
of mutually orthogonal positive isotropic roots ai of Q such that (A + p,ai) = 0, A{\) = 
{«!, . . . ai}. We put ^A{\) = and call it the degree of atypicality of X (say it is if 
A{X) = 0.' then X is called typical). 

Although the choice of ^(A) is not unique, the degree of atypicality does not depend 
on it. 

Then, for any weight /x, x\ = Xfj, is equivalent to the fact that /i can be written as 
'u;(A + p + uioi + . . . + niai) — p, where w £ W and G C for all i = 1, . . . , / (see [26]). 

Notice that if Xx = Xfii then A and p have the same degree of atypicality. So the degree 
of atypicality is a well defined notion for a central character. 

For any non-isotropic /3 G A put /3 := j^^- 

Definition 3. - A parabolic subalgebra p C g with Levi part I is called admissible for a 
central character x if, for any dominant X such that Xx = X, one has {X + p, 0) > for 
all /? G A+ - A([). 

For example, if g = g[(m, n), then a distinguished Borel subalgebra ([16j) is admissible 
for any central character, and therefore so is any parabolic subalgebra containing this 
distinguished Borel subalgebra. If the simple roots of a Borel subalgebra are all isotropic, 
then p = and any parabolic subalgebra containing this Borel subalgebra is admissible 
for any central character. 
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Lemma 5. (^Typical lemmaj - Let X be a dominant weight, let p be a parabolic subalgebra 
of Q admissible for xx- Assume A{X) C A(l) and {X + p,(3) > for all (3 G — A([) (in 
this case we will call X p-typical). Then, 

r,(G/p,L.(p)) = {^;,;(^;>°„ 

Proof. - Let be an irreducible subquotient in Ti{G/ P, Lx(p)). Then by Lemma [3] there 
exist w W and I C such that 

(1) fi = w{X + p)-p-J2'^- 

a&I 

Choose an element /i G f)* such that 

A(p) = {ae A\{a,h) > 0}. 

Note that A(l) = {a G A|(a, h) = 0}. 

We claim that {p, h) < (A, h). Indeed, let s £ W be such that s{X + p) belongs to the 
positive Weyl chamber. Since (A + p, /3) > for ah /3 G A+ - A(l), s belongs to the Weyl 
group of [q. Since s{h) = h we have (s(A + p) , h) = (X + p, h) . Then 

w{X + p) = siX + p)- kp(5. 

with some non-negative kf^ since s{X + p) lies in the positive Weyl chamber. Therefore 
{w{X + p), h) = {s{X + p), h)-Y, h) < is{X + p), h) = {X + p, h). 

Therefore by ([T|) 

(p + p,h) = {w{X + p), h) - ^(a, h) < {w{X + p), h) <{X + p, h). 

On the other hand, xa = implies 

u{p + p) = X + p+ ^ kaOi 
aeA(A) 

for some u G W. Since p is dominant, we obtain by the same argument as above 
{p + p,h) > {u{p + p),h) = {X + p,h) + ^ ka{a,h) = {X + p,h). 

Hence {p, h) > (A, h). Thus, in fact (A, h) = {p, h). 

That implies that {w{X + p),h) = (A + p,h) and / C A^([). Since (A + /0,/3) > for 
all /3 G A^ — A([), w belongs to the Weyl group of [q- It follows from the construction of 
w in the proof of Lemma [3] that w = id and i = 0. By Lemma [21 is a subquotient of 
^(s) ®U{p) L\{p). Therefore p = X. □ 

Note that the proof of the above lemma implies the following 

Corollary 2. - Let X be a dominant weight, p be admissible for x\ CL^d h £\]* be such that 
A(p) = {a G A|(a, h) > 0}. IfL^^ occurs inV i{G / P, Lx{p)) with non-zero multiplicity, then 
{p, h) < (A, h). If, in addition, {X + p,$) > for all (5 £ A^ - A([), then (p, h) = (A, h) 
implies i = and p = X. 
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4. Induction for geometric induction 

We choose two parabolic subalgebras of g containing b such that b C p C q C g. 
The aim of the present section is to relate, for a p-dominant weight n, the cohomology 
r,{G/Q,Lx{q)) with both T,{G/P, Lx{p)) and T,{Q / P, L^,{p)). 

Definition 4. - For A, B any P, Q, G such that B C A, we define the Poincare polynomial 
in the variable z: 

K^A%{^) := Y.[UA/B,Lx{b)) : L,{a)]z\ 

We denote by the coefficient of . 

The following result was first stated in |25j : 

Proposition 1. (Euler caracteristic formula) - Letp be a parabolic subalgebra of q, denote 
by I its Levi part and set 

Do = n,,^j(e"/2 - e-/%D^ = U^^^^{e-/' + e-^/'),D = ^. 

For any p-dominant weight X, one has : 

At w&W Q!eA+([)V ) 

Proof. - The left hand side of the formula is 

dimGo /Po 

{-iych{H\G/p,cx{pr)- 

i=0 

Using Definition [H one gets that the left hand side becomes 

dimGo I -Po 

^ (-l)*C/i(F^(Go/Po, (e,A(p)')*)*). 

1=0 

We use the classical Borel-Weil-Bott theory to get 

dimGo /Po 

{-iyCh{H\Go/Po, {(BkCxip)')*)*) = E e{w)w{Ch{(BkCx{p)')e 



po^ 

Do 

^ W&W 



Remember now that Q)k^\{p)^ = 2^Go/Po(^a(P) '^"(fl/Cflo © Pi)))- A direct computation 
gives the proposition. 

□ 

Theorem 1. - One has : 

^G'"p(-i) = E4:p(-i)^aQ(-i)- 

V 

Proof. - Denote by vr : GjP — > G/Q the canonical projection. The fibre of vr is isomorphic 
to Q/P. Consider the derived functor (of sheaves) R*tt^, it transforms Cxip)* into a 
complex of sheaves R'7r^:{Cx{p)*) over G/Q. 

Take an injective resolution of Cx{p)*, over G/P and then an injective resolution 
of 7r*(£fc) over G/Q. This gives a bicomplex of sheaves over G/Q, and its cohomology is 
isomorphic to H'{G/ P, Cxip)*). 
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On the other hand, the Leray spectral sequence of this bicomplex has the term 

El^'' = HP{G/Q,RH,{C^{py)). 

One has ([E]) 

By definition of the coefficient '^K^^, we have the following identities in the Grothendieck 
groups: 

V 

[1, V 

The theorem follows when one computes the Euler characteristic. □ 

5. Blocks 

Recall that we let be the universal enveloping algebra of g and ^(fl) be its center. 
For every weight A, we write xa for the corresponding central character. 
The aim of the present section is to prove the following: 

Theorem 2. - Let X be a dominant weight with atypicality degree k, then the block 

is equivalent to the maximal atypical block of Qk containing the trivial module, where Qk is 

the following: 

if 5 = 9K'm,'n) then Qk = Ql{k,k) 

if Q = osp(2m + 1, 2n) then Qk = osp(2A; + 1, 2k) 

if g = osp(2m, 2n) then = osp(2A;, 2k) or 05p{2k + 2, 2k) 

In what follows the Borel subalgebra b is such that every simple root of bo is either a 
simple root of b or a sum of two odd simple roots of b. 

Lemma 6. - A weight A is dominant, i.e. Lx is finite- dimensional if and only if, for any 
simple root a of bo, 

• {X + p,a) G Z>o if a or ^ is simple in b; 

• if a = 7 + /3 is a sum of two isotropic simple roots then {X + p,a) € Z>o or {X + p,f3) = 
(A + p,7) =0; 

• Finally if a = /? + 7 where 7 is an odd isotropic simple root and (3 is an odd non- 
isotropic simple root, then (A + p,a) G Z>o or {X + p,a) = —1 and (A + p, 7) = 0. 

Proof. - For an arbitrary Borel subalgebra b' containing bo let A(b') denote the highest 
weight of Lx with respect to b' and p{b') be the analogue of p for b'. A weight A is 
dominant (see ^7]) if for any simple root a of bo there exists a Borel subalgebra b' such 
that a or ^ is simple in b' and (A(b') + p{b'), a) E Z>o. 

If a or ^ is a simple root of b, then we are in the situation of the first two cases and 
the statement is straightforward. If a = /3 + 7, then choose b' obtained by odd refiection 
with respect to 7. Then the statement follows from the following formulae 

A(b') + p(b') = A + pif (A + p,7) /O, 



A(b') +p(b') = A + p + 7 if (A + /),7) = 0. 



□ 
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Remark - Note that our choice of b implies that for any simple root a of bo, (p, a) = 
1,0, —1 if a is a simple root of b, a sum of two isotropic simple roots or a sum of one 
isotropic and one non-isotropic odd simple roots respectively. The latter case is possible 
only for osp(2m + l,2n). In particular, in the cases of gl{m,n) and osp(2m, 2n), every 
parabolic subalgebra of g containing b is admissible for all central characters. 

The above conditions on a Borel subalgebra determine b uniquely up to an automor- 
phism of if = osp(m, 2n). In the case of = gl{m,n) we choose the distinguished 
b. 

Here wc list the simple roots for our choice of Borel subalgebra: 

• If = 0t(m, n), m > n, the simple roots are 

£1 — £2, £2 — £3, Em — ^1, ^1 — ^2, ^n-l — ^n, 

m — n — 2 m — n — A —m — n m + n . m — n + 2 
P = 2 ^1 + 2 ^ ^ 2 ^ ^ ^ ^ 2 

• If = osp(2m + 1, 2n) and m>n, the simple roots are 

£l — £2, Sm-n+1 ~ <^1, ^1 ~ ~ Sn, Sn, 

1, , 3, 11 111, 

p= [m-n- -)£i + (m - ra - -)£2 + ... + -£m-rt - -^^m-n-l " ... - -^£771 + -^Oi + ... + -()„; 

• If = osp(2m + 1, 2n) and m < n, the simple roots are 

P = --^£1 - - - + {n-m+ -)di + {n - m - -)d2 + ... + -dn-m+i + -. + ^0^, 

• If = osp(2m, 2n) and m > n, the simple roots are 

£1 £2, £m—n ^li^l £m— n+1, ■■■i^n ~ £mi + ^m, 

p= (m- n)ei + (m - n - l)e2 + ... + Em-n+i; 

• If = osp(2m, 2n) and m < n, the simple roots are 

Si — S2, <^rt-m+l ^ Cl, El ^ <^ri-m+2, ~ ^rm + £,„, 

p= (n- m)5i + {n-m - 1)62 + ... + 5n-m+i- 

Corollary 3. Let 

A + p = ai£i + ... + am£m + + ... + bnSn- 

Then X is integral iff ai,bj € Z for Q = gl{m,n) or 06p(2m,2n), ai,bj G ^ + Z /or 
= osp(2m + 1, 2n). Furthermore, A is dominant iff the following conditions hold 

ai > 02 > ... > ttjn and 61 > 62 > ... > b^, 

• If g = osp(2m + 1, 2n), either 

1 , , ,1 
ai > a2 > ... > am > - , oi > b2 > ... >bn> -, 

or 

1 

on > «2 > ... > a-m-l-l > — ... — ttm — — - 

and 61 > 62 > ... > bn-i-i > bn-i = ... = bn = \ for some < / < min{m, n); 
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• If Q = 05p(2m,2n), either 

ai > 02 > ... > ttm-i > \am\ and 61 > 62 > •.• > 6n > 0, 

or 

ffll > 02 > ... > fflm-i-l > flm-/ = ... = flm = 

and 61 > 62 > ... > bn-i-i > bn-i = ... = 6„ = /or some < / < min{m,n). 

Let X = Xi' be a central character with atypicality degree k. Choose a self-commuting 
element x = J2a&A{i/) -^a- Let C{x) denote the centralizer of x in g. Then [x,^] is an ideal 
in C{x) and one can choose a reductive subalgebra Qx C C(x) such that C{x) = Qx® [x^ fl] 
(see [9]). This choice is canonical if the Cartan subalgebra is fixed. Denote by U{q)^ the 
set of ada;-invariants in U{q). One can prove ([9j) that U{gY = U{qx) ®U{Qx)[xM{q)\- 
Consider the projection p : U{qY ~^ U{qx) with the kernel U{qx)[xM{q)\- The restriction 
of p to the center of Z{q) defines a homomorphism Z{q) — > Z{qx)- Consider the dual map 

p* : Hom(Z(0,),C) ^ Hom(Z(0),C). 

It was shown in [9] that the preimage {p*)~^{x) consists of one central character x' ^ 
Hom(Z(0a;), C) unless g = osp(2m, 2n). If g = osp(2m,2n) then {p*)~^{x) might consist 
of two central characters x' ^^id x" such that one is obtained from another by an involutive 
outer automorphism of Qx — osp(2m — 2k, 2n — 2k) (induced by an automorphism of 
o(2m — 2k)). In the latter case by x' we denote the central character corresponding to a 
dominant weight with non- negative marks. 

Terminology - We call x' core of x- 

If = f) n Qx, p' = ^(EaeA+(g,) « " EaeA+(0,) «)' ^^en x' = X/., where ^ + p' is the 
restriction of v + p to \)x- It is a simple but very important observation that the central 
character x is uniquely determined by its core x' ■ 

Lemma [6] and Corollary [3] imply the following 

Lemma 7. - The core x' is a typical dominant central character of Qx- 

Assume that x has degree of atypicality A; > 0. Then, independently of the choice of A 
such that xa = X; the Lie superalgebra Qx is isomorphic to one of the following (see [9]) 

• if g = Ql{m, n) then g^^ ~ g((p, q) with p = m — k, q = n — k; 

• if g = osp(2m + 1, 2n) then g^^ ~ osp(2p + 1, 2q) with p = m — k,q = n — k; 

• if g = osp(2m, 2n) then g^^ = osp(2p, 2q) with p = m — k,q = n — k. 

In all cases it will be convenient to encode the core x' by the corresponding dominant 
typical weight + p' of g^; . In what follows we write 

X ■= p + p' = aiEi H h apEp + 61^1 H h bqSg, 

where ai,bj satisfy the additional assumptions of dominance and typicality with respect 
to Qx (and additional positivity condition for g^ ~ 05p{2p,2q)), more precisely 

(3) oi > • • • > aj,,5i > • • • > bq, 

(4) aj,6j G Z,aj / -6j if g = g[(m,n), 

(5) Oi, bj + Z>o, Qi / bj if g = osp(2m + 1, 2n), 



(6) 



Oj e Z>o, bj e Z>o, ai / bj if g = 05p(2m, 2n). 
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We call the numbers Oj, bj the marks of the core. 

Now we define 0x corresponding to a connected sub-Dynkin diagram containing 
the last node(s) of the diagram of g in the following way: 

• if g = gl{m, n) then g^ ~ g[(/c, fc); 

• if g = 05p(2m + 1, 2n) then g^^ ~ osp(2/c + 1, 2/c); 

• if g = osp(2m, 2n) and Op > 0,then g^ ~ 05p{2k, 2k); 

• if g = osp(2m, 2n) and Op = 0,then g^ ~ osp(2A; + 2, 2k). 

Let p be the parabolic subalgebra containing b whose Levi part is I = g^^. + f). Assume 
that X is such that p is admissible for x and A is a dominant weight such that Xx = X- 

Terminology - If in addition A is p-typical, we call A stable. 

Let denote the subcategory in J^^ consisting of all g-modules with all weights < A. It 
is not hard to see that if A is stable then the highest weight of any simple g-module in J^^^ 
is also stable. By .?^<;^(0 we denote the corresponding truncated category of [-modules 
with central character from the set was defined just before Lemma H|). 

Define the functors Res : J-^ J-^{1) and Ind : J^^{1) — > J^^ by 

ResiV = N'^,lndM = To{G/P,M), 

recall that m stands for the nilpotent radical of p. 

Lemma 8. - Assume that A is stable. Then the functors Res and Ind establish an equiv- 
alence between the categories and J^^^{p). 

Proof. - The statement easily follows from the typical lemma, (Lemma [5]). Indeed for any 
simple module L^{p) G J^^^{p), Indl/^(p) = Tq{G/ P, L^{p)) = is the unique simple 
quotient of U{q) <^u{p) L^ip). All the higher cohomology groups vanish. Therefore Ind is 
an exact functor which maps a simple module to a simple module. Clearly, 

IndRes(L^(p)) ~ L^(p), ResInd(L^) ~ L^, 

therefore the lemma holds. □ 

Our next step in the proof of Theorem [2] is "to move" any simple module to J^^x using 
translation functors. Recall the definition of translation functors (see [Ij): let ^ be a 
finite-dimensional g-module. One defines a functor T{V)^''^ : JF^ JF"^ by T{V)^''^{M) = 
(M (g) V)^. It is not difficult to see that T{V)^''' is exact and T{V*)^'^ is left adjoint to 
T{V)^''^. The following lemma is also straightforward (see for example [Ij). 

Lemma 9. - If both T{V*)'^''^ and T{V)^''^ move a simple module to a simple module, 
then they establish an equivalence between the categories and . 

Lemma 10. - Let r and x be central characters. Assume 

• for any dominant fj, with x^l = X there exists a unique weight 7 of V , such that fi + j 
is dominant and Xfj.+'t = 

• for any dominant v with Xu =t there exists a unique weight 7' of V* such that + 7' 
is dominant and Xu+'y' = X! 

• the multiplicities of 'j inV and 7' in V* are 1. 

Then TiV)^''^ and T{y*Y'^ establish an equivalence between the categories and T"^ . 

Proof. - It suffices to prove that T(y)^''^(L^) = for any G J^^. 

First we note that a b-singular vector in (L^^V)'^ has weight /i + 7. Hence T{V)^''^{Lf^) 
has a unique up to proportionality b-singular vector. Since T(1/)^''^(L^) is contragredient, 
it is either zero or L^j^^. It is left to prove that T{y)^''^{L^) ^ 0. 
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Let denote the one-dimensional b-module of weight fi. Since 

To{G/B, Cf,(^V) = To{G/B, C^) V, 

and {Cf, ® Vf^^^ has only one dominant component Corollary [T] and Lemma [2] 

imply the isomorphism 

TiV)^'^To{G/B,C^)) ^ ToiG/B, C^+^). 

Assume that T{V)^''^{L^) = 0. Then, since TiV)^''^ is exact, there must be a simple 
subquotient L^/ in ro(G/-B,C^)) such that T{V)^''^{L^') = L^+^y. Therefore fi' + 6 = 
/X + 7 for some weight 5 of V. But the conditions of the lemma imply that = 
Contradiction. □ 

Let E denote the standard g-module. 

Lemma 11. - Let x be a central character with degree of atypicality k > and core 
x' = aiEi + ... + apEp + bi6i... + bq5q. Let V = E or E* and 5 he a weight of V . Assume 
that x' + i^ satisfies the conditions ^3^-^ and in addition for g = osp(2m, 2n) the numbers 
of zero marks in x' + ^ and in x' o,re the same. Let r be the central character such that 
r' = x' + 6. Then T(V)^''^ and T{V*Y'^ establish an equivalence between and J-'^ . 

Proof. - Since V = E or E*, every weight 7 of ^ has multiplicity 1, moreover 7 = zbsj, ziz6j 
or 0. The proof can be reduced to checking the conditions of Lemma [TO] for any L^ E J-^. 
We will consider here the most tedious case of g = osp(2m, 2n), (5 = ±£i, the other cases 
are completely analogous and we leave them to the reader. 

Since x^l = X there are the following two possibilities: either (11 + p, ej) = Oj for a unique 
j < m or {fi + p, Em) = —CLi (in the latter case {p, + p, Ej) > ai for all j < m). 

Let 6 = Ei. In the former case take ly = p + Ej ii {p + p, Sj-i) > + 1. If [p + p, Ej-i) = 
Qi + 1, there exists I such that {p + p, Ej-i + (5/) = and one should take u = p — 5i. In 
the latter case take = p — Em '^f {p + p, ^m-i) > + 1. If {p + p, £m-i) = ai + 1, there 
exists k such that (p + p, Em-i + Si) = 0, take v = p — 5i. 

Now deal similarly with the case 5 = —Ei. In the former case take v = p — Ej if 
\{p + p,Ej+i)\ < Oi — l. If {p + p,Ej+i) = aj — 1, there exists / such that {p + p,Ej+i + 5i) = 
and choose v = p + 5i. li {p + p, Sj+i) = —ai + 1, then j + 1 = m, there exists k such that 
{p + p,Em — Si) = and choose v = p + 5i. Finally in the latter case take v = p + Em- D 

Lemma 12. - Letk be the degree of atypicality of x, x' = aiEi + ... + apEp + hi5i... + hq5q. 
Let p he the parabolic subalgebra with Levi part { = \] + which contains b. Let A be 
a dominant weight such that Xa = X- There exist a central character r such that p is 
admissible for t, and a dominant stable weight p, such that Xfi = and '^^ equivalent 

Proof. - Let 

X' = aiEl + ... + UpEp + bl6l + ... + bqSq. 

If oi > bi in osp case, oi > —bq in g[ case, put x'l = x' + ^i) l^t xi be the central character 
with core x'l- In this way proceed to increase ai so that it is bigger than the absolute 
value of any coordinate of A plus p + q. li ai < bi in the osp case, increase bi in the same 
manner. In the g[ case, if oi < —bq decrease bq. After this, pick up the next mark in x' 
and increase (decrease) it following the same method to the absolute value of the previous 
mark -1. Proceed in the same manner with all marks of x' increasing the absolute value 
of each mark (except = in the 05p(2m, 2n) case). Call the resulting core r', and let 
r be the corresponding central character. As follows from Lemma [TT] the categories J-^ 
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and T'^ are equivalent via a composition of translation functors, which we denote by T . 
Then T(L\) = and one can easily check that is stable and p-typical. Hence is 
equivalent to ^<^. 

We would like to illustrate the above argument with few examples. 

Let g = 0[(3, 2), A + p = (2, 0|3, 0, -1), then + p = (7, -1|1, -5, -6). 

Let g = 05p(5,4), A + p = (|, -\% |, \), then /i + p = (|, -\\\, |, \). 

Let g = osp(4,6), A + p = (4, -2|3, 2, 1), then + p = (7,-116,5,1). □ 

Lemma [T^ and Lemma [H] imply Theorem [2J Indeed, by Lemma [T^ for any dominant A 
with xa = X the truncated category T\y^ is equivalent to the "stable" truncated category 
for a suitable choice of //. The latter category is equivalent to ^<^(0 by Lemma [H 
Finally, .^<^([) is equivalent to the truncated part of the most atypical block of g^^ since [ 
is the direct sum of g-^ and a center. Since A is arbitrary one can extend this equivalence 
to the whole . 

6. Weight diagrams and translation functors 

In this section we define an alternative way to describe dominant weights following 
Brundan and Stroppel. Their method allows one to visualize the action of the translation 
functors defined in the previous section. 

Let T C M be a discrete set, X = (xi,...,^;^) G T™, Y = (yi,.. .,?/„) € T". A diagram 
fx,Y is a function defined on T whose values are multisets with elements <, >, x according 
to the following algorithm. 

• Put the symbol > in position t for all i such that Xi = t. 

• Put the symbol < in position t for all i such that i/i = t. 

• If there are both > and < in the same position replace them by the symbol x , repeat 
if possible. 

Thus, fxyit) may contain at most one of the two symbols >, <. We represent fx,Y by 
the picture with standing in position t whenever f{t) is an empty set. 
Let g = g((m,n). Let A be a dominant integral weight such that 

A + p = aiEi + ... + amem + hi8i + ... + 6„(5„. 

Set T = Z, 

Xx = {ai,...,am),y\ = {-bi, ...,-bn). 
The diagram fx = fxx,Y\ is called the weight diagram of A. 

A diagram is the weight diagram of some dominant weight if and only if f{t) is empty or 
is a just one element set since both sequences oi, am and 6i, bm are strictly decreasing 
and hence do not have repetitions. 

Each dominant weight is uniquely determined by its weight diagram. The number of < 
is n, the number of > is m (counting x as both < and >). The number of x equals the 
degree of atypicality. Replacing all x in the diagram by zeros gives a diagram of the core. 
For example, the diagram 

...,<, x,0,0,>, X,... 

where . . . stand for empty positions and the left x is at position 0, corresponds to the 
weight 

A + p = (4,3, 0|1, 0,-4). 

The translation functor TiV)^''^ described in LemmafTDmoves a simple module L\ € J-^ 
to € J-'^ such that is obtained from f\ by moving a symbol < or > at position t 
to the next right position t + 1 or to the next left position t — 1 (the position t and the 
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direction are determined by a choice of the core r'). Assume that the chosen direction 
is to the right. If the next to the right position has or x, we exchange the symbols in 
position t and t + 1. For instance, 

...,<, 0,... ^ ...,0,<,... 

...,<, X ,.. . > X ,<,... . 

The situation when the next to the right symbol is < or > is forbidden by the conditions 
on X ^-nd r (see Lemma fTTI) . We move < or > to the left using the analogous rule. 

Now for any dominant weight A, let A be the corresponding weight in the equivalent 
most atypical block of q^. Then is obtained from f\ by moving all symbols <, > to 
the right of all crosses by the procedures described above and then replacing all of them 
by 0. In our example f^^ is 

...,x,0,0,x,... 

with left X at position —1. 

Note also that shifting a weight diagram by one one position to the right corresponds 
to tensoring the corresponding module with the one dimensional representation of weight 

Now let Q = osp(2m, 2n). Set T = Z>o. For a dominant weight A such that \ + p = 
aiEi + ... + amEm + hSi... + bnSn let 

Xx = {\ai\,...,\arn\),Yx = (6i, /a = fx^Xx- 

It is not difficult to see that fx is a weight diagram of a dominant A if and only if 

• for any t ^ 0, fxit) is empty or just one element set; 

• the multiset /a(0) does not contain <, contains > with multiplicity at most 1 (it can 
contain any number of x). 

For example, if A = (2,0,0|3, 0), then fx = x)0, >,<,... . However, in this situation 
a weight is not uniquely determined by its weight diagram. More precisely, if /(O) ^ 0, 
there is exactly one weight with the weight diagram /, since all the coordinates of such a 
weight are non-negative. If /(O) = 0, then the coordinate a corresponding to the first > 
or X can be chosen positive or negative. For instance if 

/ = 0,0,<,x,>,..., 

then the two weights (4, 3j3, 2) and (4, — 3|3, 2) are dominant and have / as their weight 
diagram. 

Terminology - To differenciate those two weights we call a dominant weight positive if it 
does not have negative coordinates, and negative otherwise. 

The core of a weight can be obtained by replacing by all x in the diagram. The 
translation functors from Lemma[TT]can be described in the same way as in previous case, 
except that we do not allow a symbol to move from or to the zero position. Indeed, if 
we want to move > from the zero position, we can get two weights corresponding to the 
same diagram, which means that the translation functor does not provide an equivalence 
of blocks. Thus, in this case we have two types of blocks, one with zero mark at its 
core (> at the zero position), and another without it. The former case corresponds to 
= osp(2/c + 2, 2k), the latter corresponds to Qy. = 05p(2A;, 2k). Note that the atypicality 
degree k, as before, is the number of x in a weight diagram. Finally, to get the weight 
A corresponding to A in the most atypical block, as in the gt case, we move all <, > to 
the right of all x (except one at zero position) and then replace them by 0. A positive 
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weight goes to a positive one, and a negative weight goes to a negative one under this 
correspondence. 

Below are two examples: 

if /a = 0, 0, <, X , >, X , . . . , then = 0, 0, x , x , . . . ; 
if /a = $,0, >,<,..., then f-^ = <,0,.... 

Now let us discuss the case osp(2m + l, 2n). We assume that A is dominant and atypical, 
then all coordinates a^, bj of A + p belong to — ^ + Z>o. Let T = ^ + Z>q and define Xx, 
Yx and fx as in the case g = 05p(2m,2n). The dominance condition is equivalent to the 
following condition on a weight diagram / 

• f{t) is empty or one element set for any t 7^ ^; 

• /(^) may contain at most one of < or > and any number of x. 

As in the previous case, it is possible that two dominant weights have the same weight 
diagram. That may happen if /(^) does not contain > or < and has at least one x. For 
example, the diagram with two x at ^ corresponds to — ^||, ^) and to (— ^, — ^). 
The translation functors, unlike in the previous case, mix those two types of weights. So if 
the weight diagram has at least one x and no <, > at the position ^ we put an indicator 
(which we sometimes refer to as "sign") it before the weight diagram in parentheses. Its 
value is + if the corresponding weight has the form 

\ + p = (ai, am-s, 2' ~2 ' ~2 ""' 
and — if the corresponding weight has the form 

11 1 

A + p = (ai, Gm-s, -■^^-■^,---^--^\h,---,bn), 

where s is the number of crosses at the position ^. 

The translation functors of Lemma [TT] act on the diagrams, as in the previous case. The 
only difference is that one allows to move < or > from the position ^ to the right but 
such move transforms a diagram without indicator to one with it. If /(|) = 0, then the 
indicator of the new diagram is — , if /(|) = x, then the indicator is +. For example 

<,0,... — > (-)x,<,... 



X , X , . . . > ( + )x ' <) • • • 

Moving < (resp. >) at the position | to the left is possible if /(|) does not have < or 
> already, and therefore either /(|) = or /(^) must have an indicator. If the indicator 
of / is — we just move < (resp. >) to the position ^ and put /(|) = 0. If the indicator 
of / is +, one should exchange < (resp. >) at the position | with one x at the position 
i. For example, 

(_)x,<,0,... ^<,0,... 
(+)x,<,0,... — X, X,... 

To get the weight A in the most atypical block corresponding to A, one does the same as 
in two previous cases (one moves all < and > to the right of all crosses and then replaces 
them by 0). 

Remark - It is clear from above that the most atypical blocks with trivial central char- 
acters of Lie superalgebras osp(2A: + 1, 2A: + 2) and 05p(2A; + 1, 2k) are equivalent. 
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7. Reduction to the most atypical case 

Lemma 13. - Let a be a simple root of bo such that either a is a simple root of b or 
a is a sum of two isotropic simple roots ai + 02- Let q he the parabolic subalgebra with 
Levi part i containing b such that a, respectively ai,a2 are orthogonal to all roots in A([). 
Assume that v is a {-dominant weight, such that [v + p,a) =0 (and {v + p,aj) at 
least for one j in the second case). Then Ti{G/Q, Li,(q)) = for all i > 0. 

Proof. - Consider the parabolic subalgebra p obtained from q by adding the roots —a, 
(— ai, —02 in the second case). The fibres of the canonical projection vr : G/P — > G/Q 
are isomorphic to G'/B', where q' is isomorphic sl(2) in the first case and s[(l,2) in the 
second case, b' = g' H b. We claim that Cu{p)*j-^fjj.^ is acyclic. Indeed, in the first case 
^i^ip)* fibre invertible sheaf on P^, and the condition {u + p,a) = immediately 

implies that it is acyclic. In the second case the underlying variety {G' /B')q is isomorphic 
to F^. To calculate the cohomology we use Penkov's remark. The sheaf ^u{p)*fif,re 
a filtration with four simple terms, one dominant O^, two acyclic terms O^-an Ou-a2, 
and one antidominant Ou-ai-a2- If the cohomology groups of J~-uip)*fn,re non-trivial, 
they must be one-dimensional. But that would imply {u + p,ai) = {u + p, 0:2) = 0. 
Contradiction. 

Now the statement follows from Leray spectral sequence. □ 

Lemma 14. - Let q = g[(m,n). Let X be a dominant weight and x = X\- Let V,5 and r 
satisfy all the conditions of Lemma Mli T{V)^''^{Lx) = L^j. Then 

T,{G/B,L^{b))=T{Vr'^{Ti{G/B,Lx{b))). 

Proof. - By Corollary [H one has 

T,{G/B, {V LA(b))*"'M) = T{VY^^{T,{G/B, L,(b))). 

We note that {V (E> Lx{b))^ ^^'^^ has a filtration with simple quotients L^{b) such that all 
I' p are not dominant and satisfy the conditions of Lemma [T3l Hence Ti(G/B, L^{b)) = 
for all ly p. The statement follows. □ 

Corollary 4. - Let q = n). Let X be a dominant weight with atypicality degree k, 

T be the functor which establishes an equivalence between and the most atypical block 
of Q^. Denote by X the highest weight ofT[Lx). Lf By. = B f] G^, then 



Proof. - Due to Lemma [14] it is sufficient to prove the statement for the case of stable A 
(see Lemma E]). Let p = Q^ + b. Consider the natural projection -n : G/B — > G/P, the 
fibres of vr are isomorphic to P/B = G^/B^^. We note that all the simple subquotients 
in R^Ti^CxibY^fi^J are stable, hence H\G/P,RH*{Cx{b)y,^J) = for i > 0. The 
statement follows from Leray spectral sequence. □ 

If g = g[(m, n), the above corollary reduces the calculation of the cohomology groups of 
an invertible sheaf 0\ on the fiag variety G/B (with dominant A) to the situation where 
G = Gy. and A has the same central character as the trivial module. If g = g[(m, n) it is 
known that Ti{G/B,Lxib)) = for all i > 0, and ro{G/B,Lx{b)) is the Kac module Kx- 
Hence, calculating Kq^q{z) = ^Kq^^ provides an algorithm for finding the characters of 
simple modules. That was done in [24J and we do not repeat these calculations here. 
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Instead we concentrate on the case of the orthosymplectic group. 

To do so, we have to use Theorem [H and unfortunately we are only able to calculate 
the Euler characteristic Kq'^{—1). That would be sufficient to find the characters if we 

had an assertion like 1) = 1 and Kq'^{—1) implies /U < A". 

However, in general this is not true, moreover, in some cases Kq'^{—1) = 0. So we 
should substitute B by some larger parabolic subgroup Q\ which depends on A. 

Let A be a dominant weight. Denote by qx the subalgebra of g defined by the Dynkin 
subdiagram corresponding to the simple roots of q such that all the coordinates of A 
restricted to Qx are zero and is isomorphic to osp(2s, 2s), 05p(2s+2, 2s) or 05p(2s+l, 2s). 

Terminology - We call this subalgebra Qx the tail subalgebra of the weight A and the 
module Lx, and call s the length of the tail of A. 

The reader can check that s is the number of x's at (respectively ^) in the weight 
diagram except the case when the indicator has +. In the latter case s is the number of 
X at ^ minus 1. Let q;^ be the parabolic subalgebra with Levi part g^- 

Lemma 15. - Let X be a dominant weight and x = X\- Let V,5 and r satisfy all the 
conditions of Lemma\ll[ Let T{V)^''^{Lx) = L^. Then Qx = and 

Ti{G/Qx, L^{^x)) = T{VY^%Ti{G/Qx, Lx{qx)))- 

Proof. - The same as of Lemma [T31 D 

Lemma 16. - The functor T from to the most atypical block of containing trivial 
module, which provides an equivalence of categories, preserves the tails of simple modules. 

Proof. - Straightforward. □ 

For a dominant weight A let A be the weight oiT{Lx)- Let be the parabolic subalgebra 
of g whose Levi part is ()+0a- The following corollary can be proved exactly as Corollary HI 

Corollary 5. - Let X be a dominant weight with central character x- Then 

The above corollary reduces the calculation of Kqq_^{—1) to the case where g is one of 
osp(2A;, 2k), osp(2/c + 2, 2k), osp(2/c + 1, 2k), and A and /i have the trivial central character. 



8. Recursion 

In this section we assume that g is either osp(2A;, 2k), 05p{2k + 2, 2k) or osp(2/c + 1, 2k). 
Then all the simple roots are odd and the Dynkin diagram of g is either 

«)-... 

(with 2k vertices if g = 05p(2A;, 2k) and 2k + 1 vertices if g = osp(2A; + 2, 2k)) or 

(g) - ... - (g) ^ • 

(with 2k vertices for g = osp(2/c + 1,2A;)). The corresponding Borel subalgebra is called 
mixed (|14j). 

Let be the subalgebra of g generated by all the simple roots of g except the first 
two, 5^ be the subalgebra of generated by all the simple roots of except the first two 
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etc... Each time 5* has the same type as q. Let p* be the parabohc subalgebra with Levi 
subalgebra P = 1) + s* for z < /c — 1, and let p'^ = b. We have a flag of parabolic subalgebras 

(7) 5 D p^ D ••• D p'' = b. 

In this section, we assume that the simple finite-dimensional module Lx has the same 
central character as the trivial module, and we denote this central character by x- the 
case of 05p(2A;, 2A:), we also assume that A is positive. That implies 

A + p = aiEi + ... + afcCfc + bi6i + ... + 6^(5^, 

Moreover, |aj| = \bi\ for all i < k. The weight diagram of A does not have symbols >, < 
except > at for = osp(2/c + 2, 2k). 

Remark - Let g = osp(2A;, 2k) and 

A = ai(ei + 6i) + ... + ak{ek + 6k), 

define 

A' = ai(ei + 5i) + ... + aki-Sk + 5^). 

If a is the automorphism of Q induced by the symmetry of the Dynkin diagram, and M°' 
is the module obtained from M by twisting by a, then = Ly. Since a acts on G/P^, 
one has 

K^^p,{z) = K^^j!,[{z). 
Thus, if we know K^^p^{z) for all positive A, we can easily obtain them for all A. 

In this section, we give a recursion procedure to compute the polynomials -fC^'pi(z). 
This recursion is double: if A is "far from tail and far from the even walls" (Proposition 
[2]) , we get it " closer to the tail and the walls" . If A is close to the wall and far from the tail 
(Proposition [3j) we decrease the rank of the Lie superalgebra. Finally, when A is very close 
to the tail, we compute the cohomology directly (Propositions [U [5] in the next section). 

For a Laurent polynomial F{z) € C[z, we denote by F{z)j^ the polynomial obtained 
from F{z) by removing the monomials with negative powers of z. 

Notation - Let a = ei + 5i. 

Before we start, we prove several technical statements that will be needed later. 
Recall that E denotes the standard g-module. 

Lemma 17. - Let t he a dominant central character with degree of atypicality k — 1. Then 
(Lx fX) E)'^ is either simple or zero. 

Let P = Ei + 6i, X — P is dominant and Oj > |. Let r = xx-Si or xx-Si- Then 
{Lx ^E)^ = 0. 

Proof. - There exists at most one weight j oi E such that A + 7 is dominant and XA+7 = t- 
The best way to see it is via weight diagrams. Indeed, the weight diagram of A + 7 is 
obtained from that of A by "separating" one x in two halves >, < and moving one half 
one position to the left or to the right. It is clear that in this way one can get at most one 
dominant weight diagram with given core. Hence the first statement. 

To prove the second statement, assume the opposite, say, {Lx (g) E)^ = Lxs^- Let M^^ 
denote the Verma module with highest weight vr. Then {Mx EY has a filtration by 
Verma modules with highest weights A — 7 for all weights 7 of -E such that XA-7 = By 
direct inspection, \ — 5i is the only such weight. Therefore {Mx®E)'^ = Mx-s^. Similarly, 
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{M\-i3®EY has a filtration by Verma modules, one of the terms of this filtration is M\s.. 
Thus, Lx^Si occurs in {M\^p ® EY . 

It is known (one can find a proof in [TT]) that 



Since all weights of S are strictly less than A — /3, A — 5j is not a weight of (5 ® E)^, hence 
the latter does not have a simple component L\Si- Therefore, by above, the multiplicity 
of L\-Si in {FfSiEy is zero. But {F(^EY is a highest weight module with highest weight 
X — 6i. Therefore {F (g) EY = 0. Since Lx is a quotient of F, we get {Lx ® EY = 0. 



The following lemma is very important in our calculations. We will use it in induction 
step to reduce the rank of q. 

Lemma 18. - Let t ^ x be a dominant central character with atypicality degree k or k — 1, 
n be a dominant weight with central character r (see section 5 for definition). Assume 
that (k + p,a) = 0. Let T be the functor establishing an equivalence between J-"^ and the 
maximal atypical block of Qt- Let T{L^) = Lfi^Qr). Then 



where C Gr is the analogue of P for Gr ■ 

Proof. - The weight diagram has x at the rightmost non-empty position, and symbols 
< and > somewhere to the left of this x . Using translation functors one can move those 
symbols next to the rightmost x. (If one of those <, > is at position we don't move it, 
just move the second symbol.) Those translation functors commute with rj(G/P^,») as 
their action on simple -modules is the same as on the corresponding g-modules. Hence 
we can assume without loss of generality that < and > stand next to the rightmost x 
of K. Let q = p\ + h. We claim that, in this case, Ti{G/P'^ ,L^{p^)) = Vi{G /Q,L,^{<\)). 
Indeed, this follows from the fact that the restriction of n on is typical with respect 
to = q n 0T- > and by the typical lemma, the Leray spectral sequence for the canonical 
projection vr : G/Q — > G/P^ degenerates, {R^'k*C*^ = for all g > 0). Now consider the 
translation functor which moves < and > to the right of the rightmost x . This functor 
commutes with Vi{G/Q.,»)., since it moves a simple q-module to the one whose simple 
subquotients are all acyclic except one (as in the proof of Lemma fill) . To finish the proof 
use stability of the weight obtained from k by translations and proceed as in the proof of 
Corollary HI □ 

Let % = osp(2A; -|- l,2fc). Let A' = A if the diagram of A does not have a sign. If the 
weight diagram of A has a sign let A' denote the weight whose diagram is obtained from 
that of A by switching the sign. For example, if A = 0, then A' = ei. 

Recall that ^ is defined just before Lemma HI 




{F(g)EY 0. 



0. 



Lemma is proven. 



□ 



Lemma 19. - Let q = osp(2A; -|- 1, 2k). Then T{EY'^ is an equivalence of categories, and 
T{EY^HLx) = Ly. 
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Proof. - The only dominant weights with central character x of the form A + 7, 7 being a 
weight of E, are A and A'. It suffices to show then that T{E)^'^{L\) = Lxi for A' 7^ A. 

A direct calculation proves the statement for E {X = £1) and for the trivial module 
(A = 0). Choose a maximal parabolic subalgebra p with semi-simple part s such that 
-L;^(s) is either standard or trivial. Then 

(LA(p)®i?)*"(^) = Lv(p), 

and 

(8) (ro(G/P,LA(p)) ® EY = ro(G/P, Lv(p)). 

Note that Tq{G/P, L\i (p)) does not contain any subquotient isomorphic to L\, because the 
corresponding parabolically induced module does not have Lx as a subquotient. Therefore 
the exact sequence Tq{G/P,L\{^)) Lx ^ 0, after application of T{E)^'^, becomes 
Tq{G/ P, Lx'{p)) Ly — > 0. That implies the statement. □ 

We call T{Ey^'^ the switch functor. Lemma [T] and Lemma [19] imply that for any 

(9) K'^^p,iz) = K'^;^[iz). 

Proposition 2. - Let ai > | and ai > \a2\ + 1 if k > I. Then 

i) K^'^pAz) = iz-'K^;;f{z))+ for i^^{\X- »}, 

ii) K^^pi{z) = 1 
Hi) K^^pl"'{z) = 1. 

To prove the proposition we start with the following 

Lemma 20. - Let A be as in the proposition, v = A — ei. One has the following short 
exact sequence of -modules: 

^ La (pi) - (L,(pi) ® ^ LA_„(pi) ^ 0. 

Proof. - Consider the case g = osp(2A; + 2, 2k) or osp(2/c + 1, 2k). Note that p^ -irreducible 
subquotients of E are L^^^ (p^), (p^) and L±5i(pi). All of them except Lf;^{p^) are 
one-dimensional. It is easy to check that the only p^-dominant weights of the form 1^ + 7 
(7 being a weight of E) with central character x 3-^6 A and A — a. Hence we have 

(L,(pi)®L_,,(pi))*"'W = (L,(pi)®L,,(pi))*"W = 

= (L,(pi)0L5,(pi))*''W = O. 

On the other hand, 

L^(pl) (g)L_5,(pl) = LA-a(p^), 

L,(pi)®L,,(pi) = LA(p'). 
The exact sequence follows immediately. 

The case g = osp(2/c,2/c) can be done in the same way with the substitution of 82 in 
place of £2- n 

The short exact sequence of Lemma [20] leads to the following long exact sequence: 

• ■ ■ ^ T,{G/P\Lx-a{p^)) ^ To{G/P\Lx{p^)) ^ T,{G/P\ {L,{p') i?)*"' W) ^ 

-^ro{G/P\Lx-a{p'))^0. 
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By Corollary [T] we have 

T,{G/P\ (L,(pi) ® = (r,(G/P\ L,(pi)) ® £;)>^. 

Now note that u is pi-typical. Therefore ri(G/P\ (Li.(pi)) = for all i > 0, and 
ro(G/P^, (L;y(p^)) = Ly. Thus, the exact sequence degenerates into the following 

(10) r,(G/P\LA-a(p')) =^r,_i(G/P\LA(p^)) fori> 2, 

and 
(11) 

^ T^{G/P\Lx-a{p^)) ^ ro(G/P\LA(p^)) ^ (L, ^ ro(G/P\ LA_a(p^)) ^ 0. 

Now we concentrate on the last exact sequence. 

Denote by Vx the image of Tq{G/P^ , L\{p^)) in {Ly ® E)^. Since Vx is isomorphic to a 
quotient of ro(G/P^, La(p^)), Lemma [2] implies that Va is generated by a highest vector 
of weight A. Lemma [231 below explains the structure of Vx- 

Lemma 21. - The module {Ly®E)^ is a contragredient Q-module with a unique irreducible 
submodule and a unique irreducible quotient isomorphic to Lx-a- 

Proof. - The module {L^ (8) E)^ is contragredient because the tensor product of contragre- 
dient modules is contragredient and all the simple modules are contragredient. The only 
dominant weights of the form + 7 (7 being a weight of E) with central character x are 
A and A — a. Hence they are the only possible weights of b-singular vectors in (L^ (g) E)^. 
The exact sequence 1111 implies that {L^ E)^ has simple subquotients isomorphic to Lx 
and Lx-a- 

Assume that the socle of {Ly CS) E)^ contains a b-singular vector of weight A. This gives 
an inclusion Lx C {Ly (8> E)^ and, by duality, a surjection (Ly (8) E)^ Lx- Since there 
is only one vector of weight A, the composition of those two maps must be the identity, 
thus the exact sequence [11] splits. Hence Tq{G / P^ , Lx{p^)) is contragredient too, and since 
it's generated by a b-singular vector of weight A — a, it must be equal to Lx-a- Thus, if 
{Ly E)^ contains Lx, it is equal to Lx © Lx-a- 

Let us show that this is impossible. Assume the opposite. Then 

C = Homg(LA, Ly(g)E) = Homg(LA (S) E, L^), 

hence (La ® E)^" = Ly. But Lemma [TTl (with r = Xv) implies (La ® E)^" = 0. Contra- 
diction. 

So now, we are sure that the socle of (L^ (g) E)^ is isomorphic to Lx-a] by duality, the 
same holds for the head, which is a quotient of Tq{G/P^ , La(p^)). □ 

Lemma 22. - The only weight fi such that L^ may occur as a simple subquotient in both 
ro(G/pi,LA(pi)) andro{G/P\Lx-a{p^)) isX-a. 

Proof. - We prove the lemma by induction on the dimension of q. Let g be the small- 
est for which the statement is not true. Let L^ occur in both ro(G/P^, La(p^)) and 
ro{G/P^,Lx-a{p^))- Assume first that ^ ^ if g = 05p(2A; + 1,2k) or osp(2A; + 2,2k). 
Let uj be the highest weight of E, (w = ei if g = osp{2k + 1,2k) or 05p(2A; -|- 2,2k) 
and (5i if g = osp{2k,2k)), and let r = Xfi+ui- Clearly r satisfies the conditions of 
Lemma [181 ^^id (L^ E)"^ = L^+^;. Therefore, by Corollary [H L^+(^ occurs in both 
V^{G/P\ (La(p^) and T^{G/P\ (La-„(p) ® 
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Note that the first mark of /i is strictly less than that of A — a by Lemma El hence one 
can apply Lemma [TTl to and get some dominant weights Ai and A2 such that 

(LA-.(pi)®i?)*"W=LA,(p^). 
Moreover, it is easy to check that A2 = Ai — a. Therefore K^^p^'^{0) 7^ for i = 1, 2. 

ByLemmadH occurs in both ro(G,/P,i, (pi)) and'ro(G,/P,i, (L),^(pi)). Note 

that A2 = Ai — a', where a' is the analogue of a for Qt- Thus, since the statement of the 
lemma is not true for Qr, that contradicts the minimality of Q. 

If /i = and = 05p(2A; + l,2fc) or osp(2A; + 2,2fc), we can not apply Lemma [T71 In 
the case g = 05p(2A; + 1,2A;) one should use fj,' = ei and ([9|). If = osp(2fc + 2, 2/c), we 
use the automorphism a induced by the symmetry of the Dynkin diagram. Note that a 
acts trivially on the modules with central character x but switches some simple modules 
in the block with central character r. One gets 

(LA(pi)®i?)*"W=LA,(pi)eL^,(pi), 

(Lx-aip') <S) Ef-'^^^ = La, (pi) e Ll^ip') 

for some dominant weights Ai and A2 such that A2 = Ai — a. Since is cr-invariant, it 
occurs in the image of the functor Fq of all four summands, and one can finish the proof 
as in general case. □ 

Lemma 23. - One has the exact sequence: 

^ Lx-a ^Vx^Lx^O. 

Proof. - Recall that we have the exact sequence 

O^Vx^iL,® Ef ^ To{G/P\Lx-a{p^)) ^ 0. 

From Lemma [20] we know that Lx~a is a submodule of Vx and Lx is the quotient of 
Vx by the unique maximal submodule A^. Suppose that has another subquotient 
with n ^ X — a. Denote by A'^' the orthogonal complement to N with respect to the 
contravariant form on {Ly®E)^. Since N' has a simple subquotient La, we have Vx C N' . 
But (L^ ® E)^/N' is isomorphic to the module contragredient to N, hence it must have a 
subquotient L^. Thus, we obtain that L^ is a subquotient in both TqIG/P^ , Lx{p^)) and 
Fo(G/P\LA_„(pi)). That contradicts Lemma [221 □ 

The identity (fTO]) , the exact sequence (fTT]) and Lemma [23l imply Proposition [2l 

Terminology - A pair of weights (A, /i) is called exceptional, if K^^p^{z) ^ and the first 
coordinate of /i is less than the second coordinate of A. 

Proposition 3. - Assume k > 2, X is such that ai = 02 + 1, and 02 7^ ^, — 1,0. Assume 
that (A, fi) is not an exceptional pair. One has: 
^g!p^^^^ = ^^P^ji2{z) ^//^ / A, A - a; 

a) Kj^p^{z) = 1; 

Hi) K^^p["{z) = 0. 
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Let 

u = X-5ifoT Q = 05p(2A; + 1, 2k) or 05p(2A; + 2, 2k); 

= X — ei for = osp(2A:, 2k). 

Note that v is not dominant but is -dominant. Observe also that u satisfies the conditions 
of Lemma [13] for q = p^ . Therefore 

(12) ri(G/P^/:^(p2)) = Ofor alH > 0. 

Lemma 24. - One has K^^p^{z) = zKpjp2{z) for any fi^ u, and K'^"p^{z) = 0. 

Proof. - The notations are adapted from those of the proof of Theorem[Tl Let vr denote the 
canonical projection vr : G/ G/P^ . The derived functors {WiT^Cy{p'^)*) have the fol- 
lowing property which can be easily obtained from Lemma [3] applied to Ti{P^ / P"^ , Ly{p'^)): 

- the second coordinate of /i + p for any ^ f such that occurs in (i2'^7r*£i^(p^)*) is 
strictly less than ai — 1, hence any such /i is p^-typical; 

- Ly only occurs in {R^'Kj,Ci,{p^)*). 

Hence the second terms of the Leray spectral sequence are all zero except -Eg'*^ and £'2''^ 
(for any p, q): it is just the typical Lemma O 

Now the identity (fT2]) asserts that this spectral sequence converges to zero. So the 
conclusion is that there is an isomorphism between i?2''^ and £^2'^"^ and £2'*^ = (it can't 
come from anybody and in the end it should be zero). So 

HP{G/P\U(^y) ~ H\G/P\W-^T:Xu{f)*) 

and 

w>-\x.{p'r) = HP-\p'/p',c.{p%,,j. 

We write the decomposition in the Grothendieck group of p^ -modules: 
[H^~\P'/P',C,{p%^,J] = J^^-^i^pr p,[L^(p^)*] 

and all the fi-s are p^-typical except fi = v. Using the typical lemma O we instantly get 
that 

[HP{G/P\C,ip')*)] = Y,P-'K^p^^p,[L,{p')*] 

the equality holding in the Grothendieck group of g-modules. This finishes the proof. □ 

Now we are ready to prove Proposition [3l Since (A, p) is not an exceptional pair, the 
first coordinate of /i equals either the first coordinate of A or the second coordinate of A. 
In the former case X = fi (see Corollary [2]) . So we consider the latter case. Let co stand 
for the highest weight of the standard g-module. By straightforward check of weights we 
get 

(La(p')®£)*"(>^'')=L.(P^), 
{Lf,0E)^^ =L^+^. 

On the other hand, if C is another weight such that K^'^pj^{z) ^ 0, we have (L^ E)^" = 
L(^j^^ if the first coordinate of Q equals the second coordinate of A, and (L^ E)^" = 
otherwise. Hence if 7^ /x, (L^ E)^" ^ L^+o;. Therefore, using Corollary [1] we obtain 

K'^'^pAz)=K-^priz). 
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By Lemma \2M 

K^aTiz) = zK^p^piz). 
Since i^pCp'^(z) does not depend on the first coordinates of the weights, we have 

K pi p2 (2) = p2(^z). 

Note that u — uj = A — a, therefore (i) of Proposition [3] is proven. To show (ii) observe that 
Lx occurs with multiplicity 1 in Tq{G/P,L\) by Lemma [2] and does not occur in higher 
cohomology groups by Lemma El Finally, A — a is not dominant, hence (iii) is trivial. 

9. Pretails 

We keep the assumptions of the previous section. Below we list all weights which do 
not satisfy the conditions of Proposition [2] or Proposition [3l 

(1) trivial weight A = 0; 

(2) the highest weight A = ei of the standard representation in the case g = osp(2/c + 
l,2fc); 

(3) A = £1 + (^1 for = osp(2A:, 2k) or 05p(2/c + 2, 2k)] 

(4) A = 2ei + 5i for g = osp(2A; + 1, 2k) or osp(2fc + l,2k + 2); 

(5) A = 2ei + £2 + -51 for g = osp(2A; + 1, 2k) \k > 2). 

In the first case the tail of A has length k, hence qA = 0- In the other four cases the 
tail has length k — 1, we call such weights pretail weights. The goal of this section is to 
calculate K^^pi{z) for every pretail weight A. 

Let q be the maximal parabolic subalgebra corresponding to the first simple root, I be 
its Levi part. Clearly, q D p-*^. 

Lemma 25. - For any pretail weight A we have 

k'g'pM = k'gU') 

for all fi. 

Proof. - Consider the canonical projection vr : G/P^ — > G/Q. Note that a pretail weight 
A is p^ n [-typical. Hence Ri7T*Cx{p^)* = for g > and R°7r*CxiP^)* = ^xU)*- Now the 
statement follows immediately from Leray spectral sequence. □ 

Lemma 26. - Let q = 05p{2k, 2k) or osp(2/c + 2, 2k). Then K^'^q{z) = i/ ^ 7^ 0, 

K^°q{z) = 1 + z^''-^ ifg = osp(2A:, 2k); 
K^°q{z) = l + z'^^ ifQ = 05p(2A: + 2, 2k). 
Proof. - By Definition [1] and Penkov's remark 

Ch{r,{G/Q, C)) < Ch{r,{Go/Qo, 5* (0/(00 e qi)))). 

We are going to describe the simple components of the qo-module 5" (0/(00 qi))- 

If = 05p{2k,2k), let E' denote the standard o(2A;)-module and q" = q n5p(2/c), then 
qo = o{2k) © q" and one has the following isomorphism of qo-modules 

5^(3/(flo e qi)) ^ A^iE') M L^psAq"), 

where Kl means the tensor product as C-vector spaces. If p" is the half-sum of positive 
roots of sp(2A;), then —p5i + p" is not regular for all p except p = or 2k. The classical 
Borel-Weil-Bott theorem shows that there are two non-zero cohomology groups in degree 
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and 2k — 1. Since Lemma [2] implies that ro(G/(5, C) / 0, these two components can not 
cancel in the filtered module. 

If = 05p{2k + 2, 2k), let E" denote the standard sp(2/c)-module and q' = q n o{2k + 2), 
then qo = q' ® sp(2/c) and one has the following isomorphism of qo-modules 

5"(0/(0oeqi))=.L_p,,(q')KA^(i?"). 
Further arguments are exactly the same as in the previous case. □ 

Lemma 27. - Let g = osp{2k + I, 2k). Then 



/X 7^ £1, 
K'^}'g{z) = { liffM = ei 

^2^-1 if jj = 



Proof. - We do calculations as in the previous lemma. Let E" denote the standard 5p(2A;)- 
module and q' = qno(2/c+l), then qo = q'©sp(2A;) and we have the following isomorphisms 
of qo-modules 

L,,(q)=.L,,(q'), 

LeM) ® ^^(0/00 e qi) ^ L^l-p)eM) ^ ^'(E")- 
There are exactly three non-acyclic components 

L,,(q'),i?",L(i_2fc),,(q')^A2^(i?"). 

These components give rise to the standard g-module in degree and the trivial module 
in degree 2k — 1. □ 

Proposition 4. - Let q = 05p{2k,2k) or 05p(2A; + 2,2/c) and X = ei + Si be the pretail 
weight. 

'i) If 9 = osp(2A;, 2k) and k > 1, then 

( lifn = X 
I else 



ii) If Q = 05p(2,2), then 

^G,P^\^> - ^ else 
in) If Q = 05p(2A; + 2, 2k) then 



pi 



1 if fi = X 
else 



Proof. - We will calculate Kqq{z) instead of K'^^p^^{z) (see Lemma (251) Let oj be the 
highest weight of the standard module E. It is not difficult to see that oj is q-typical. In 
all cases except osp(2, 2) there is the short exact sequence of q-modules: 

^ LA(q) ^ (L^(q) ® ^ Lo(q) = C ^ 0, 



■^for osp(2, 2) this does not work since the standard o(2)-module is reducible and {L\{(\) ® has 
one more subquotient L_£:j+ij(q). 
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where X = Xa • As in the proof of Proposition O the corresponding long exact sequence 
degenerates in (fTOl) and ([TT]) . It remains to study the structure of {L^j i?)-^ = {E ® E)^. 
It is different in the two cases. 

If = 05p(2fc + 2, 2k), k>l, then 

and Lemma [26] imphes (iii). 

If = 05p{2k,2k), then E ® E has two trivial subquotients. (One can see that, for 
instance, looking sX E®E* for gl(2A;, 2/c)). Therefore, for a suitable Vx, one has the exact 
sequences 

and 

^ Lo ^ l^A ^ J^A ^ 0. 

Now (i) follows from Lemma [26l 

The case osp(2,2) can be easily done by a straightforward calculation similar to those 
in the two previous lemmas, and we leave it to the reader. □ 

Proposition 5. - Let g = 05p(2/c + 1, 2k). 

i) Let Ai = 2ei + 5i then 

{1 if = \i or El 
z^^-^ iff, = . 
else 

ii) If ^2 = 2ei + 62 + 5i then 

{1 if fi = X2 or 
z^^~^^f^, = e^ . 
else 

Proof. - Let us prove (i) . As in the previous proof, using Lemma [25| we may calculate 
Kq^q{z) instead of K^^pi{z). Consider the exact sequence of q-modules 

^ Lx, (q) ^ {Lx,-s, (q) ^ i^)*"' W ^ ^Ai-a(q) = L,, (q) ^ 0. 

We leave to the reader to check that all arguments in the proof of Proposition [2] go through 
and it holds for A = Ai. Thus, (i) follows from Lemma [271 

To show (ii) just use the switch functor. □ 

10. Exceptional pairs 

The goal of this section is to describe exceptional pairs. It is convenient to do in terms 
of weight diagrams. First, we fix some terminology. We call < and > core symbols. In 
what follows we refer to (resp. |) as the tail position and denote it by so- For any s < t 
in T we denote by lf{s,t) the number of x-s minus the number of 0-s strictly between s 
and t. By |/| we denote the double number of x-s plus the number of core symbols at the 
tail position. 

First, by the results of the previous section, if (A, ^) is exceptional and A is a pretail, 
then = osp(2A; + 1, 2k), A = 2ei + £2 + 61 and /i = 0. 
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Proposition 6. - Assume that A is not a pretail weight and lett + 1 be the position of the 
rightmost x in fx. The pair (A,/i) is exceptional if and only if the following conditions 
are true 

(a) fx is obtained from f^ by moving two x from the tail position to the adjacent non-tail 
positions t and t + 1 (if fx cLnd f^ have signs, they remain the same); 

(b) lf^{sQ,t) is odd for Q = osp {2k +1, 2k) or 05p{2k,2k) and even for q = 05p{2k-\-2, 2k); 

(c) lf^{s,t) < for any s < t; 

(d) l/Jso,t) + |/A| >0. 

// (A,/u) is exceptional, then K^^i{z) = 1. 
The proof of Proposition [6] takes the rest of the section. 
Lemma 28. - 

i) Let Q = osp(2A;, 2k), t = xsi- If ai = ^ for some i, then {Lx <S> E)'^ = 0. 

ii) Let g = 05p{2k + 2,2k), r = Xeu k be a dominant weight with central character r. 
Then [L^ ® E)^ = L^-^. L^^^., where i is such that Oj = 1. 

Hi) Let g = 05p(2A; + 1, 2k), r = X2ei ■ If o-i = ^ for some i, then {Lx EY = 0. 

Proof. - (i) Assume first that \ = ei + 6i. If (La «> E)'' / 0, then (La ® EY = E (by 
looking at the weights). But as follows from the calculations in the proof of Proposition [3] 

Homg(LA, E(E)E) = Homg(LA (g>E,E) = 0. 

Hence (La E)^ = 0. 

In the general case, by above, we have (La(p*^^) ® E)^ ("^^ = 0. Hence 

{ro{G/p'-\Lx{p'-'Y®Er = 0. 

Since La is a quotient of To{G/P'''^ , Lx{p^~^)) we obtain (La «) E)^ = 0. 

(ii) We use {E (g) E)^ = L^^+Si © Lq- That imphes 

(L,(p-i) 0l;)*"^w = L«_,,(p-i) eL,+5.(p'-'). 

(Keep in mind that the standard module for the Levi part of p*~^ has highest weight Ei). 
Therefore 

(ro(G/P*'\ L«(p^-i)) ® i?)^ = ro(G/P^-\ L,_,^(p^-i)) ro(G/P^-\ L,+5, (p-i)). 

Clearly, (L^ E)^ is a quotient of the right hand side. Let S denote the submodule of 
ro(G/P*-i,L«(p^-i)) such that L^ = Tq{G/P^-^,L^{p^-^))/S. All weights of S are less 
than K. Therefore {S^E)^ can not have simple components isomorphic to L^-ej or Li^^g., 
hence {L^(^E)^ must have these components. Since {Li^^E)^ is contragredient and its b- 
singular vectors may have only weights K — £i and K+5i, we have {Lf^C^E)^ = Lfi-£.(BL^^s^ 
(see the proof of Lemma [21] for details). 

(iii) First, observe that if Oj+i = ^ then there are no dominant weights of the form A + 7 
with 7 being a weight of E such that XA+7 = t. Hence we may assume that aj+i = — ^ 
or i = k. By comparison of weights either (La E)'^ = or (La 03 E)'^ = Lx-Si- Consider 
the exact sequence as in the proof of Lemma [T7] 

0^5^ Mx-p ^Mx^F^O, 

where (3 = £{ + 6i. Check that (Ma <g E)^ has a filtration by Verma modules such that 
their highest weights are not greater than X — 5i. Hence Lxs^ occurs in (Ma ^ E)^ with 
multiplicity 1. Now one can finish the proof by the same arguments as in the proof of 
Lemma [T71 □ 
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Till the end of this section (i = £2 + ^2-, '^1 as usual, denotes the highest weight of E. 

Lemma 29. - Let fi and v he dominant weights with trivial central character, r = Xm+i^- 
Assume also that fi ^ in the case q = osp(2/c + 1, 2k) or osp(2A: + 2, 2k). If {L^ (g) E)'^ = 
L^+uj, then v = ^i. 

Proof. - For /u 7^ ei,0 the lemma easily follows from Lemma [T71 The condition /i 7^ 0, ei 
ensures that ^ + uj = v + e-i ov + uj = v + 5i ioi some i. Since Xfi = Xu = Xo, we have 
fi = I'. 

If ^ = ei, then g = 05p(2A; + 1, 2k) and by Lemma [28jiii) we again have n + lo = u + Si 
for some i and the statement follows by the same reason. 

Similarly, if g = osp{2k, 2k) and n = 0, one can prove the statement using Lemma [28|^i). 

□ 

Lemma 30. - Let (A,/^) be an exceptional pair, = fi + uj and r = X/i+o;- Assume again 
that /i 7^ in the case q = osp(2A: + 1,2/c) or osp(2A; + 2,2k). There exists a dominant 
weight Ai such that 

(L,(pi)^i?)*-^M = L,,(pi) 

and 

K'^^p^iz) = K'^ynz) = K':%iz). 

Proof. - Since (L^ ^ Ey = L^j , we know that L^^ occurs in some 

r,(G/p\(LA(p^)®i?)*"(^)). 

Hence (La(p^) W / 0. If -E' denotes the standard p^-module we have the following 
identity in the Grothendieck group: 

[(L,(pi) = [W,(pi)] + [L,_,,(pi)] + 

+ [L^+sAp')\ + [Lx-sAp')] + [(^a(p') ® E')"'"^^)]. 
Since the first coordinate of /i is less than the second coordinate of A, 

and 

(La (pi) = (La(p') ® i?')*"^"^- 

Lemma [T71 applied to p^-modules implies that (La(p^) £")* ^^'^^ is simple, hence it is 
isomorphic to Lai(p^) for some p^-dominant Ai. By the condition on the first coordinate 
of /i, Ai is dominant. 

Finally, since (L^ ® E)'^ = L^^ , the multiplicity of L^^ in Ti{G/P^ , (Lai (P^)) is at least 
the same as the multiplicity of L^ in Ti{G/P^, (^a(P^)). Hence 'K^^pi < 'K^pl. But by 
Lemma[29](L,y(8)£')'^ 7^ for any v [i and we must have "^K^^p^ = ''K'^pl. Lemma [THl 
implies K^'piz) = K^'fj^Az)- 

n 

Corollary 6. - Use the notations of the previous lemma. Let (A, fi) be an exceptional 
pair, r be the position of the rightmost x in f^, and assume that r ^ sq. Then f\{r) = 

fx{r + 1) = 0, (Ai,/Ui) is an exceptional pair for g^- and K^^pi{z) = K^^''^pi{z). 
Furthermore, ffi-^ is obtained form f^ by removing the x from the r-th position and 



f-xAt) 



fx{t) ift<r 
fx{t + 2) ift>r 
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Lemma 31. - Let q = 05p{2k + 2,2k), and X = (2, 1, 0, ...|2, 1,0, ...)• Then K^%{z) = 1. 

Proof. - Let k = X — 62 and t = Xn- By Lemma [TSl K^^p^{z) = K^^ p^{z). Therefore, by 
Proposition [H 

1 /X = K 



By Lemma [28] (ii) 



else 



(L«(pi) ® = La (pi) e LxMp'). 

By Propositon [2] and Proposition HI we obtain 

f li//x = A-/? 

[ else 

By Corollary [J 

{Ti{G/P\L^{p')) = Ti{G/P\Lx{p')) e ri(G/P\ LA-/3(pi)), 
and by Lemma [28] (ii) 

(E E)^ = Lo e , (L« ® S)^ = La e La-/?. 

Therefore 

if^f^(z)=K^/'°(.) + K^;%(z), 



and we have ir^'pi(z) = 1. □ 

Lemma 32. - Let q = osp(2A; + 2, 2k), t = Xoj, fJ- be a dominant weight with trivial central 
character. One has{L^ ® Ey = E if and only if fi = or ei + 61. 

Proof. - Since lo = fi ± Si or fi ± 5i, the only possible values for n are and ei + 61. 
Obviously (Lq Ey = E. To check that (L^-^+Si ® Ey = E, use 

Homg(Le^+5^ (g)E,E) = Rom^iLe^+Si ,E(g)E) =C. 

□ 

Lemma 33. - Let q = osp(2/c + 2,2A;) (resp. 05p{2k,2k)). Then (A,0) is an exceptional 
pair if and only if 

X = (a, a — 1, 0, ...|a, a — 1, 0, ...), 
a < 2k — 2 is even (resp. a < 2k — 3 is odd). If X satisfies the above conditions, then 
<pi(^) = l- 

Proof. - We will prove first that if A satisfies the conditions of Lemma, then K^^p^{z) = 1. 
The proof will be done by induction on a and k, the base case a = 2 is done in Lemma [3T1 
In this proof t = Xlu- 

First, let g = osp(2A; + 2, 2k). Set Ai = X + e^. By Lemma [TH] and induction assumption, 
we have 

K'^]';iiz) = K^^^'p,iz) = l. 

By Lemma [28lf ii) we have 

(LA,(pl) 0i^)*"'W = Lxip')(BLx+es+5siP'), 
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and we have 

Uomp.{Lx,{p')^E,Lx{p')) = Rom^^ {L {p' ), Lx{p') ^ E) = C. 
That imphes 

Thus, by Corollary [T] and Lemma [32] we have either K^^p^^''{z) = 1 or i^^'pi(z) = 1. 

However, the case K^'^p^^^ (z) = 1 is impossible by Corollary [6] and we have -K'q pi (z) = 1- 
Now let Q = 05p(2A;, 2k). Set Ai = A + 83. Using the argument similar to above we have 

By Lemma [251fi) . one has 

and by Lemma [29] K^^^, (z) = 1. 

Now we will show that if (A, 0) is an exceptional pair, then A must satisfy the conditions 
of the lemma. The proof again is by induction on k. Consider two cases /a(1) = x and 
/a(1) = 0. 

In the first case Lemma [30] implies that g = osp(2/c + 2, 2k). Let i be such that = 1 
and Ai = A — 5j. K^^pj^{z) 7^ implies 

iLxip^)0E)'^-'(-^ = LxAp') 

and 

K'^-;i{z)=4-%{z)^0. 

By induction assumption 

Ai = (a, a — 1, 0, ...ja, a — 1, 0, ...), Ai = (a + 1, a, 1, ...|a + 1, a, 0, ...), 
and K^''pl{z) = 1. But 

(L,,(pi) ® = L,^-,,{p') e L,^+5,ip')- 

Since Lq occurs with multiplicity 1 in ro(G/P^, -Lai-£3(P^) ® (p^)), and since we 

have proved already that (Ai — £3,0) is exceptional, we obtain that (Ai + 5^,0) is not 
exceptional. 

Finally, if /a(1) = 0, take Ai = A + (resp. Ai = A + Repeat the above arguments 
to show that (Ai,0) is again an exceptional pair. By induction assumption 

Ai = (a, a — 1, 0, ...ja, a — 1, 0, ...), 

hence 

A = (a + 1, a, 0, ...ja + 1, a, 0, ...). 

n 

Lemma 34. - Let q = osp(2A; + 1,2A;). Then (A,0) (resp. {X,ei)) is an exceptional pair 
if and only if 

1 11,1 11, 
X + p= {a+ -,a ..\a + -,a- -,-,...), 

(resp. 

1 111, 1 11,, 
A + p=(a + -,a--,-,--,...|a + -,a--,-,...),) 
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where a is odd and a < 2k — 4. If X satisfies the above conditions, then p^{z) = 1 
(resp. K^^piiz) = I). 

Proof. - It suffices to prove lemma for the pair (A,ei), since the second case fohows by the 
use of the switch functor. The proof is similar to one for the previous lemma, but much 
easier. Let r = X2£i- Note that ir^'pi(z) / implies 

Then by Lemma [28] (iii) /a(|) = 0, f\ has positive sign and 

(L,(pl)®i?)*-^W=L;,,(pl), 

where Ai = A + for i such that aj = ^. Now use 

and proceed by induction decreasing k. The process stops when Ai = 2ei + £2 + 5i is a 
pretail weight (see Proposition [5]). □ 

Now Proposition [6] follows easily from Corollary [Gj Lemma [33] and Lemma [Ml bv induc- 
tion on number of x outside the tail position. 

11. Combinatorial algorithm for calculation of K^^pi{z) and Kq^q^{—1) 

The recursion formulae obtained in two previous sections determine uniquely the Poincare 
polynomials K'^^p^{z) in the most atypical block. In this section we obtain a closed for- 
mula for them and use it to compute Kq^^{—1). The results will be formulated in terms 
of weight diagrams. The recursion uses double induction on the position of the rightmost 
X (Proposition [2]) and on the total number of x. 

We still assume that we are in the most atypical block containing the trivial module. 
However, keeping track of the signs of weight diagrams in the case g = 05p(2A; + 1, 2k) is 
annoying. To get rid off those signs, we use the equivalent block of 05p{2k + 1, 2A; + 2) with 
trivial central character. Weight diagrams lying in this block have < at the tail position. 
(To obtain a signed diagram from the most atypical block of osp(2A; + 1, 2k) from such a 
diagram /, one has to shift all entries of / except one at the tail position one position left 
and assign — if /(|) = and + if /(|) = x.) 

By our assumption the core symbols can only be at the tail position. 

If f{t) has X, then let ft denote the diagram g obtained from / by removing x from 
position i, (naturally g{t) = Q\it becomes empty). Similarly, we denote by /* the diagram 
obtained from / by adding x to position t. Thus, /* denote the diagram obtained from / 
by moving x from s to t. 

Definition 5. - We say that g is obtained from f by a legal move if s <t, f{s) contains 
^> /(O = ^> 9 = fs ^^fi ^/ following conditions holds 

(1) f{s) does not have a core symbol, lf{s,r) > for any s < r <t and lf{s,t) > 0; 

(2) s is the tail position, \g\ +lf{s,r) > for any s <r <t and \g\ +lf{s,t) > 0. 

The positions s and t are called the start and the end of a legal move M . The degree 
1{M) of a legal move is defined to be lf{s,t) in the first case and \g\ + lf{s,t) in the second 
case. A legal move is called ordinary if its start is not a tail. Otherwise we call a legal 
move a tail legal move. 
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Warning. A legal move is actually the following data: two diagrams / and g and the 
degree of the corresponding move. Sometimes there are two legal tail moves of different 
degrees which transform / to the same diagram g. They should be considered as different 
moves. For example, the diagram ^,0,... can be transformed to x, x,... by two different 
legal moves, one of degree and one of degree 2. 

Definition 6. - Let sq denote the tail position. We say that g is obtained from f by an 
exceptional move if 

9 = (/.^o)*so f""^ ^^^^ ^ < = = 0; 

/j(a, s) < for all a < s and \g\ + //(sq, s) is a positive odd number; 
lf{s,b) > for all s < b < t and lf{s,t) > 0. 

Define the end position of an exceptional move to be t and the degree to be lf{s,t). 

Proposition 7. - Let A and fx be two dominant weights with trivial central character and 
A 7^ 0. Then ^K^^^^ = 1 if = X and i = or fx is obtained from f^ by a legal move 
(or by an exceptional move) of degree i, with end at the position of the rightmost x of fx. 
Otherwise, "^K^^p^ = 0. 

Proof. - If A = /i the statement is obvious, if (A, fx) is an exceptional pair, the statement 
is proven in Proposition [6l For other cases the statement follows from Propositions [21 [3] 
by induction on the position of the rightmost x and the number of x-s in fx, the base of 
induction being done in Propositions HI [5] and Lemma [271 One has to translate Proposi- 
tion[3]and Lemma [271 from signed diagrams to diagrams with < in the tail position, which 
can be done by direct comparison. □ 

Corollary 7. - The multiplicity of any simple module in T i{G / , Lx{p^)) is at most one. 

Corollary 8. - Let A and fx be two dominant weights with trivial central character and 
A 7^ 0. Let t be the position of j-th x in fx counting from the right. Then ''Kpjti pj = ^ if 
fjL = \ and i = 0, or if fx is obtained from f^ by a legal move (or by an exceptional move) 
of degree i with end t. Otherwise, ^Kpf_j^ p^ = 0. 

Let Dg denote the oriented graph whose vertices are dominant weights of g, and edges 
are defined as follows: 

if fx is obtained from by a legal move or exceptional move, we join A and fi by an 
edge fi — y A. 

We put a label {s,t;uj) on an edge, where s and t are the start and the end of the 
corresponding legal move and w is its degree. If the move is exceptional we put the label 
(so : s,t;w). 

A path consisting of edges corresponding to legal moves with ends ti,...,tg is called 
decreasing resp. increasing if ti > ... > tq (resp. ti < ... < tg). (It follows immediately 
from the definition that, in any path, ti ^ ii+i-) The degree 1{R) of a path R is the 
sum of the degrees of all legal moves corresponding to the edges included in R. It is 
straightforward that Dg does not have oriented cycles. 

Theorem 3. - Let V^{fi,\) denote the set of all decreasing paths from fx to A. Then 
(13) <"q.(-1)= E (-l)'^""^- 

RGP>(At,A) 
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Proof. - Let r be the number of x outside the tail position in fx. Then Theorem [1] and 

Corohary [8] imply 

(14) 

<Q.(-i)= E <'i^,p.(-i)i^^;L^rpU(-i)...A'^:^^^ E (-i)'^""^- 

□ 

Remark - One can easily generalize Theorem [3] to an arbitrary block due to Corollary [5l 
Legal and exceptional moves are described in the same way. We completely ignore core 
symbols outside the tail position. 



12. Characters 

In this section we give a combinatorial algorithm for computing characters of simple 
modules. 

Let S\ denote the right hand side of formula ([2]) in Proposition [T] with p = q^. Note 
that since Lx{c\x) is one-dimensional, Ch{Lx{c\x)) = e'^- 

The identity ([2]) provides a linear system of equations, which can be solved for Ch{Lx). 
Let K denote the infinite matrix with coefficients Kq^q^[—\). Then IC is lower triangular 

with 1 on diagonal. Let D = and D'^'^ denote the matrix coefficients of D. Then ([2]) 
implies 

(15) C/i(La) = J^I^^'^f^. 

Remark - One can see that the graphs and the matrices IC and D for g = osp(2A;+2, 2k) 
and = osp(2/c + 1, 2k) are the same if one identifies weight diagrams by switching > to < 
at the tail position. It is natural to conjecture that the maximal atypical blocks in these 
two cases are equivalent. 

Theorem 4. - Let V^^fx, A) denote the set of increasing paths from fi to X in Dg, and \R\ 
denote the number of edges in a path R. Then 

(16) D>^^^= (-l)'^''^+l''l. 

Proof. - Write K = 1 + U, where U is strictly low triangular. Then 

D = 1 - U + U^ - ... 
Let i?i o i?2 denote the concatenation of paths Ri and R2. Then (jl3p implies 

(17) D^''^= E (-i)^+'(^), 

R€P{fj.,X) R=RioR2...oRi\RjeV> 

where V{^,X) denotes the set of all paths from // to A and is the set of all decreasing 
paths. 

Any path R ^ (/x. A) has more than one term in the second sum, since there are 
several ways to write it as a concatenation of decreasing paths. It is a simple exercise to 
check that in this case the second sum is zero. Hence the only paths contributing to the 
formula are increasing. Hence (jlGh holds. □ 
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Remark - In case g = osp{2k,2k) Theorem [4] provides the formula for Ch{L\) only for 
positive A. For negative A, we apply the automorphism a defined in Section 7, and we use 

Example. Let g = 05p(6,6) and A = (2, 1, 0|2, 1, 0). To find Ch{Lx), we just have 
to describe the subgraph Dg containing the vertices fi < X. There are four such vertices 
corresponding to the weights A, = (2, 0, 0|2, 0, 0), = (1, 0, 0|1, 0, 0), k = 0. They are 
connected by the edges: 
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(o,i;0) 
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s 
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(o,i;4) 
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{0,2;3) 
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Then the corresponding matrices are 



K = 



D = 
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-2 


1 
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V-4 


3 


-2 


1/ 



and 

Ch{Lx) =£x- 28^ + 2£^ - A£^. 
The case k = 1. (See [10], [13]) If g = 05p(2, 2), positive weights in the most atypical 
block are of the form aei + a5i. To simplify notations we put La = Lae^+aS-i- The graph 
-Dg is the infinite string 

(0,1;0) (1,2;0) (2,3;0) 

U > 1 > 2 > 

and the characters can be calculated by 

a 
j=0 

The matrix D is the same for osp(4, 2) and osp(3, 2). Let us consider the latter case. 

(i,j+l;0) 

Set Ao = 0, Ai = El, Aj = iei + {i — l)Si. The graph Dg has the edges Aj — '■ — ■ — > Aj+i for 
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all i > 1 and the edges Aq ^ ' ' A2, Aq ^ ' ' Ai. One can easily obtain the character 
formulae 

i=l i=l 

for p > 2, and 

13. Caps and cancellations 

Let / be a weight diagram. For every x at a non-tail position s, there exists exactly 
one legal move / — > /' of degree zero with start at s. If t is the end of that move, then 
we join s and t by a cap. Proceeding in this way we equip / with caps for each non-tail s 
such that /(s) = x. A non-tail position s is called free if f{s) = and s is not an end of 
a cap. One can easily check the following properties: 

- there are no free positions under a cap; 

- two caps do not overlap; 

- if s 7^ So, /(s) = X, then the end of a legal move with start at s is not larger than the 
end of the cap starting at s. 

We call a decreasing path R € (/i, A) regular if 

- any edge of R corresponding to a non-tail legal move corresponds to a move along a 
cap on the diagram /^; 

- any edge of R corresponding to a tail legal move or an exceptional move corresponds 
to a move with end at a free position. 

Note that all ordinary and exceptional moves which appear in a regular path must have 
degree 0. In addition, it follows directly from Definition [6] that the position s in any 
exceptional legal move (sq : s, t; w) which appears in a decreasing path from /x to A is a 
free position of 

Proposition 8. - Let TZV^^n, A) denote the set of all regular decreasing paths from /x to 
A. Then 

Proof. - Define an involution * on the set of all non-regular paths in ^^(/x. A) as follows. 
If is a non-regular path, one can find at least one cap whose left or right end is the end 
of some "wrong" legal move included in R which is not a move along this cap. Among 
such caps, pick up a cap with maximal left end. There are two possibilities: 

1. The left end t of this cap is the end of some "wrong" legal move {s,t;w) (resp. 
"wrong" exceptional move (sq : s, t; w)). Then, before the edge (s, t; w) (resp. (sq : s, t; w)) 
in the path R, there is an edge (t, u; 0) which, by our conditions, corresponds to a legal 
move along a cap. Exchange two edges {s,t;w) (resp. (sq : s,t;w)) and {t,u;0) by one 
which corresponds to a legal move {s,u;w + 1) (resp. exceptional move {sq : s,u;w + 1)) 
and get a new irregular path R*. One can easily check that 1{R*) = 1{R) + 1. 

2. The right end t of the cap is the end of some "wrong" legal move (s, t; w) (resp. 
"wrong" exceptional move (sq : s,t;w)). Note that in this case w must be positive. Let u 
be the left end of the cap. Remove the edge (s, t; w) (resp. (sq : s, t; w)) and insert {u, t; 0) 
and (s, u-jW — 1) (resp. (sq ■ s,u;w — 1)) and get a new irregular path R*. One can easily 
check that 1{R*) = 1{R) - 1. 
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Obviously, * is an involution. The statement follows from the condition (— = 

-(-lyiR), □ 

Proposition 9. - If q = osp(2n + l,2n) or osp(2n + 2, 2n) and X, fi have the trivial central 
character, then Kqq^{—1) is either zero or ±1. In other words, the entries o/K are or 
±1. 

If Q = osp(2n, 2n) and X, have trivial central character, then \Kqq^{—1)\ < 2 
Proof. - By Proposition [8] and Theorem [3] we have 
(18) <"q.(-1)= E (-l)'^""^- 

Let ti,t2,-.- be all free positions written in increasing order. Let R be some decreasing 
regular path. We call two tail moves appearing in R adjacent if they have ends ti and tj-i. 
A pair of adjacent tail moves is vanishing if there exists an exceptional move with label 
(so : ti-i,ti; 0). (In particular, i is odd in case g = 05p(2n + 1, 2n) or osp(2n + 2, 2n) and 
even in case g = osp(2n, 2n).) 

If is a regular but not strongly regular decreasing path, we pick up the first exceptional 
move or the first vanishing adjacent pair which appears in it, depending on what occurs 
earlier. Denote by R' the path obtained from R by substituting the vanishing pair instead 
of the first exceptional move (or respectively the exceptional move instead of the first 
vanishing pair). Then clearly R" = R and R and R' cancell in the summation of (jlSp . 
Hence the sum can be taken only over strongly regular paths. 

In case q = osp(2n + 1, 2n) or osp(2n + 2, 2n) one can see immediately that there is at 
most one strongly regular path between any two weight diagrams. 

If 3 = osp(2ri, 2n) there are two tail moves with the end ti, one of degree and one of 
degree equal to the double size of the tail. Hence there are at most two strongly regular 
paths between two weight diagrams. Hence the statement. □ 

14. Appendix: index of definitions and notations 
General setting 

- Integral dominant weight: Section 2. 

- <I>: just before Lemma HI 

- ^(A): Definition H 

- Degree of atypicality of a dominant weight (resp. central character): Definition [2] (resp. 
just after this definition). 

- Admissible parabolic subalgebra for a central character: Definition [3l 

- Poincare polynomial K^^{z): Definition [H 

- List of simple roots for the chosen Borel subalgebras: Section 5. 

- Dominance contitions for weights: Section 5. 

- Core of a central character: just before Lemma [71 

- (for a central character x): before Lemma [H 

- Stable weights: before Lemma [8l 
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- T'!^^: before Lemma [8l 

- Translation functors TiV)'^''^: after the proof of Lemma [8l 

- E: Standard g-module. 

- Case 05p(2m,2n), positive (resp. negative) weights: Section 6. 

- Tail subalgebra of a dominant weight A, Q\; tail of A; algebra q^: just before Lemma [T5l 

- Switch functor T{E)^'^: after the proof of Lemma [T9l 

- Exceptional pair of weights: before Proposition [3j 

- Pretail weights: Section 9. 

Weight diagrams and algorithm 

- Diagram fx associated to a weight A: defined in the beginning of Section 6. We will use 
the notations introduced there for this part of the appendix. 

- Diagram of the core: the diagram one obtains from fx when removing all the symbols 
X . 

- Is it possible to recover the weight from the diagram? Yes if g = g[(m, n), no if g = 
05p{m,2n) (see Section 6). 

- Number of x-s in the diagram: atypicality degree of the corresponding weight. 

- Indicator it and sign: see osp(2n + l,2n) in Section 6 (depends on the tail's shape). 

- Action of translation functor: see section 6. 

- Relationship between the number of x-s at and the length of the tail of A: just before 
Lemma 1151 

- Core symbols: beginning of Section 10. 

- Notation sq: tail position. 

- Notation lf{s,t): number of x-s — number of 0-s strictly between the positions s and t. 

- Notation |/|: 2x number of x-s at the tail position -|- number of core symbols at the 
tail position. 

- Notation ft: If / has a x at position t , the ft is the diagram obtained when removing 
it. 

- Notation /*: Diagram obtained adding to / a x at position t. 

- Notation /*: diagram obtained from / moving a x from s to t. 

- Legal moves, start and end of a legal move, degree of a legal move: Definition 5, Section 
11. 

- Tail legal move, ordinary legal move: Definition 5, Section 11. 

- Exceptional move: Definition 6, Section 11. 

- Decreasing, increasing paths in the oriented graph Dgi just after Corollary [HI 
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- Length of a path in a Dg. just before Theorem [31 

- Cap: Section 13. 

- Free position: Section 13. 

- Strongly regular: Section 13. 

- Regular path: Section 13. 
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